2023-07-12 13:13:27,961 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-07-12 13:13:28,179 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580 2023-07-12 13:13:28,191 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 13:13:28,191 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/cluster_2e6eebf2-882c-9df6-f703-f5434d9a427a, deleteOnExit=true 2023-07-12 13:13:28,191 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 13:13:28,192 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/test.cache.data in system properties and HBase conf 2023-07-12 13:13:28,192 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 13:13:28,193 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/hadoop.log.dir in system properties and HBase conf 2023-07-12 13:13:28,193 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 13:13:28,194 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 13:13:28,194 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 13:13:28,301 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 13:13:28,656 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 13:13:28,660 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 13:13:28,660 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 13:13:28,661 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 13:13:28,661 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 13:13:28,661 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 13:13:28,662 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 13:13:28,662 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 13:13:28,662 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 13:13:28,662 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 13:13:28,663 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/nfs.dump.dir in system properties and HBase conf 2023-07-12 13:13:28,663 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/java.io.tmpdir in system properties and HBase conf 2023-07-12 13:13:28,664 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 13:13:28,664 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 13:13:28,664 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 13:13:29,240 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 13:13:29,243 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 13:13:29,482 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 13:13:29,671 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 13:13:29,694 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 13:13:29,750 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 13:13:29,780 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/java.io.tmpdir/Jetty_localhost_localdomain_35523_hdfs____u0a1ym/webapp 2023-07-12 13:13:29,959 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:35523 2023-07-12 13:13:29,969 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 13:13:29,969 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 13:13:30,385 WARN [Listener at localhost.localdomain/35961] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 13:13:30,524 WARN [Listener at localhost.localdomain/35961] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 13:13:30,547 WARN [Listener at localhost.localdomain/35961] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 13:13:30,555 INFO [Listener at localhost.localdomain/35961] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 13:13:30,561 INFO [Listener at localhost.localdomain/35961] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/java.io.tmpdir/Jetty_localhost_37433_datanode____.8983ft/webapp 2023-07-12 13:13:30,672 INFO [Listener at localhost.localdomain/35961] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37433 2023-07-12 13:13:31,005 WARN [Listener at localhost.localdomain/44505] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 13:13:31,475 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x282e7540d3c96177: Processing first storage report for DS-59b01272-2dec-4e5d-852c-8f37aeee640e from datanode ce58e839-c48d-499d-8202-1d751ffd3861 2023-07-12 13:13:31,477 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x282e7540d3c96177: from storage DS-59b01272-2dec-4e5d-852c-8f37aeee640e node DatanodeRegistration(127.0.0.1:45429, datanodeUuid=ce58e839-c48d-499d-8202-1d751ffd3861, infoPort=44659, infoSecurePort=0, ipcPort=44505, storageInfo=lv=-57;cid=testClusterID;nsid=1733369450;c=1689167609307), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 13:13:31,477 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x282e7540d3c96177: Processing first storage report for DS-01545a91-ff08-47cf-98aa-14a6afcaf4d4 from datanode ce58e839-c48d-499d-8202-1d751ffd3861 2023-07-12 13:13:31,477 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x282e7540d3c96177: from storage DS-01545a91-ff08-47cf-98aa-14a6afcaf4d4 node DatanodeRegistration(127.0.0.1:45429, datanodeUuid=ce58e839-c48d-499d-8202-1d751ffd3861, infoPort=44659, infoSecurePort=0, ipcPort=44505, storageInfo=lv=-57;cid=testClusterID;nsid=1733369450;c=1689167609307), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 13:13:31,562 DEBUG [Listener at localhost.localdomain/44505] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580 2023-07-12 13:13:31,627 INFO [Listener at localhost.localdomain/44505] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/cluster_2e6eebf2-882c-9df6-f703-f5434d9a427a/zookeeper_0, clientPort=51470, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/cluster_2e6eebf2-882c-9df6-f703-f5434d9a427a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/cluster_2e6eebf2-882c-9df6-f703-f5434d9a427a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 13:13:31,641 INFO [Listener at localhost.localdomain/44505] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51470 2023-07-12 13:13:31,652 INFO [Listener at localhost.localdomain/44505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:13:31,655 INFO [Listener at localhost.localdomain/44505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:13:32,334 INFO [Listener at localhost.localdomain/44505] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161 with version=8 2023-07-12 13:13:32,335 INFO [Listener at localhost.localdomain/44505] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/hbase-staging 2023-07-12 13:13:32,609 INFO [Listener at localhost.localdomain/44505] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 13:13:32,976 INFO [Listener at localhost.localdomain/44505] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=3 2023-07-12 13:13:33,002 INFO [Listener at localhost.localdomain/44505] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 13:13:33,002 INFO [Listener at localhost.localdomain/44505] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 13:13:33,002 INFO [Listener at localhost.localdomain/44505] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 13:13:33,002 INFO [Listener at localhost.localdomain/44505] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 13:13:33,002 INFO [Listener at localhost.localdomain/44505] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 13:13:33,117 INFO [Listener at localhost.localdomain/44505] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 13:13:33,175 DEBUG [Listener at localhost.localdomain/44505] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 13:13:33,248 INFO [Listener at localhost.localdomain/44505] ipc.NettyRpcServer(120): Bind to /136.243.18.41:41307 2023-07-12 13:13:33,257 INFO [Listener at localhost.localdomain/44505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:13:33,259 INFO [Listener at localhost.localdomain/44505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:13:33,277 INFO [Listener at localhost.localdomain/44505] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41307 connecting to ZooKeeper ensemble=127.0.0.1:51470 2023-07-12 13:13:33,448 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:413070x0, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 13:13:33,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41307-0x10159a9c1fc0000 connected 2023-07-12 13:13:33,472 DEBUG [Listener at localhost.localdomain/44505] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 13:13:33,473 DEBUG [Listener at localhost.localdomain/44505] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 13:13:33,476 DEBUG [Listener at localhost.localdomain/44505] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 13:13:33,482 DEBUG [Listener at localhost.localdomain/44505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41307 2023-07-12 13:13:33,483 DEBUG [Listener at localhost.localdomain/44505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41307 2023-07-12 13:13:33,483 DEBUG [Listener at localhost.localdomain/44505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41307 2023-07-12 13:13:33,483 DEBUG [Listener at localhost.localdomain/44505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41307 2023-07-12 13:13:33,484 DEBUG [Listener at localhost.localdomain/44505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41307 2023-07-12 13:13:33,489 INFO [Listener at localhost.localdomain/44505] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161, hbase.cluster.distributed=false 2023-07-12 13:13:33,546 INFO [Listener at localhost.localdomain/44505] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=3 2023-07-12 13:13:33,546 INFO [Listener at localhost.localdomain/44505] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 13:13:33,546 INFO [Listener at localhost.localdomain/44505] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 13:13:33,546 INFO [Listener at localhost.localdomain/44505] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 13:13:33,547 INFO [Listener at localhost.localdomain/44505] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 13:13:33,547 INFO [Listener at localhost.localdomain/44505] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 13:13:33,553 INFO [Listener at localhost.localdomain/44505] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 13:13:33,571 INFO [Listener at localhost.localdomain/44505] ipc.NettyRpcServer(120): Bind to /136.243.18.41:41721 2023-07-12 13:13:33,573 INFO [Listener at localhost.localdomain/44505] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 13:13:33,580 DEBUG [Listener at localhost.localdomain/44505] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 13:13:33,581 INFO [Listener at localhost.localdomain/44505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:13:33,584 INFO [Listener at localhost.localdomain/44505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:13:33,587 INFO [Listener at localhost.localdomain/44505] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41721 connecting to ZooKeeper ensemble=127.0.0.1:51470 2023-07-12 13:13:33,594 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:417210x0, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 13:13:33,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41721-0x10159a9c1fc0001 connected 2023-07-12 13:13:33,600 DEBUG [Listener at localhost.localdomain/44505] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 13:13:33,602 DEBUG [Listener at localhost.localdomain/44505] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 13:13:33,603 DEBUG [Listener at localhost.localdomain/44505] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 13:13:33,603 DEBUG [Listener at localhost.localdomain/44505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41721 2023-07-12 13:13:33,604 DEBUG [Listener at localhost.localdomain/44505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41721 2023-07-12 13:13:33,605 DEBUG [Listener at localhost.localdomain/44505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41721 2023-07-12 13:13:33,608 DEBUG [Listener at localhost.localdomain/44505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41721 2023-07-12 13:13:33,608 DEBUG [Listener at localhost.localdomain/44505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41721 2023-07-12 13:13:33,610 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,41307,1689167612472 2023-07-12 13:13:33,618 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 13:13:33,619 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,41307,1689167612472 2023-07-12 13:13:33,664 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 13:13:33,665 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:13:33,664 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 13:13:33,667 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 13:13:33,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 13:13:33,669 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,41307,1689167612472 from backup master directory 2023-07-12 13:13:33,672 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,41307,1689167612472 2023-07-12 13:13:33,672 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 13:13:33,673 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 13:13:33,673 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,41307,1689167612472 2023-07-12 13:13:33,676 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 13:13:33,686 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 13:13:33,777 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/hbase.id with ID: 8fb521f3-7375-4423-8752-06ba46b32f9c 2023-07-12 13:13:33,820 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:13:33,836 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:13:33,873 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x57f02321 to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:13:33,903 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a839de6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:13:33,928 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 13:13:33,930 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 13:13:33,947 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 13:13:33,948 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 13:13:33,949 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:13:33,952 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:13:33,954 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 13:13:33,980 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/MasterData/data/master/store-tmp 2023-07-12 13:13:34,006 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:13:34,007 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 13:13:34,007 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:13:34,007 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:13:34,007 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 13:13:34,007 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:13:34,007 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:13:34,007 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 13:13:34,009 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/MasterData/WALs/jenkins-hbase17.apache.org,41307,1689167612472 2023-07-12 13:13:34,027 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C41307%2C1689167612472, suffix=, logDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/MasterData/WALs/jenkins-hbase17.apache.org,41307,1689167612472, archiveDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/MasterData/oldWALs, maxLogs=10 2023-07-12 13:13:34,074 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45429,DS-59b01272-2dec-4e5d-852c-8f37aeee640e,DISK] 2023-07-12 13:13:34,082 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:13:34,151 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/MasterData/WALs/jenkins-hbase17.apache.org,41307,1689167612472/jenkins-hbase17.apache.org%2C41307%2C1689167612472.1689167614036 2023-07-12 13:13:34,152 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45429,DS-59b01272-2dec-4e5d-852c-8f37aeee640e,DISK]] 2023-07-12 13:13:34,153 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:13:34,153 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:13:34,156 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 13:13:34,157 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 13:13:34,216 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 13:13:34,222 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 13:13:34,244 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 13:13:34,258 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:13:34,264 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 13:13:34,265 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 13:13:34,281 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 13:13:34,286 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:13:34,287 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64507853, jitterRate=-0.038758084177970886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:13:34,287 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 13:13:34,289 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 13:13:34,306 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 13:13:34,306 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 13:13:34,308 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 13:13:34,310 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 13:13:34,339 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 29 msec 2023-07-12 13:13:34,339 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 13:13:34,364 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 13:13:34,369 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 13:13:34,392 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 13:13:34,395 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 13:13:34,397 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 13:13:34,402 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 13:13:34,406 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 13:13:34,410 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:13:34,412 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 13:13:34,412 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 13:13:34,425 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 13:13:34,429 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 13:13:34,429 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 13:13:34,429 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:13:34,430 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,41307,1689167612472, sessionid=0x10159a9c1fc0000, setting cluster-up flag (Was=false) 2023-07-12 13:13:34,445 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:13:34,449 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 13:13:34,450 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,41307,1689167612472 2023-07-12 13:13:34,454 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:13:34,458 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 13:13:34,459 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,41307,1689167612472 2023-07-12 13:13:34,462 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.hbase-snapshot/.tmp 2023-07-12 13:13:34,513 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(951): ClusterId : 8fb521f3-7375-4423-8752-06ba46b32f9c 2023-07-12 13:13:34,517 DEBUG [RS:0;jenkins-hbase17:41721] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 13:13:34,523 DEBUG [RS:0;jenkins-hbase17:41721] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 13:13:34,523 DEBUG [RS:0;jenkins-hbase17:41721] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 13:13:34,526 DEBUG [RS:0;jenkins-hbase17:41721] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 13:13:34,527 DEBUG [RS:0;jenkins-hbase17:41721] zookeeper.ReadOnlyZKClient(139): Connect 0x4df55a13 to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:13:34,532 DEBUG [RS:0;jenkins-hbase17:41721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4332bddd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:13:34,533 DEBUG [RS:0;jenkins-hbase17:41721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@470d3163, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-12 13:13:34,565 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:41721 2023-07-12 13:13:34,570 INFO [RS:0;jenkins-hbase17:41721] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 13:13:34,571 INFO [RS:0;jenkins-hbase17:41721] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 13:13:34,571 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 13:13:34,574 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,41307,1689167612472 with isa=jenkins-hbase17.apache.org/136.243.18.41:41721, startcode=1689167613545 2023-07-12 13:13:34,583 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 13:13:34,591 DEBUG [RS:0;jenkins-hbase17:41721] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 13:13:34,593 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-12 13:13:34,593 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-12 13:13:34,593 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-12 13:13:34,593 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-12 13:13:34,593 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-07-12 13:13:34,593 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:13:34,593 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-12 13:13:34,593 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:13:34,595 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689167644595 2023-07-12 13:13:34,597 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 13:13:34,603 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 13:13:34,604 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 13:13:34,610 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 13:13:34,610 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 13:13:34,618 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 13:13:34,619 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 13:13:34,619 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 13:13:34,619 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 13:13:34,621 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 13:13:34,622 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 13:13:34,624 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 13:13:34,625 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 13:13:34,627 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 13:13:34,628 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 13:13:34,629 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689167614629,5,FailOnTimeoutGroup] 2023-07-12 13:13:34,630 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689167614630,5,FailOnTimeoutGroup] 2023-07-12 13:13:34,630 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 13:13:34,630 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 13:13:34,631 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 13:13:34,632 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 13:13:34,654 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 13:13:34,655 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 13:13:34,656 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161 2023-07-12 13:13:34,662 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40311, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 13:13:34,674 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:13:34,677 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 13:13:34,681 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41307] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:34,681 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/info 2023-07-12 13:13:34,683 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 13:13:34,684 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:13:34,685 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 13:13:34,688 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/rep_barrier 2023-07-12 13:13:34,689 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 13:13:34,690 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:13:34,690 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 13:13:34,692 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/table 2023-07-12 13:13:34,694 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 13:13:34,695 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:13:34,698 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740 2023-07-12 13:13:34,699 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740 2023-07-12 13:13:34,700 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161 2023-07-12 13:13:34,700 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:35961 2023-07-12 13:13:34,700 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 13:13:34,703 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:13:34,706 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 13:13:34,706 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 13:13:34,707 DEBUG [RS:0;jenkins-hbase17:41721] zookeeper.ZKUtil(162): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:34,707 WARN [RS:0;jenkins-hbase17:41721] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 13:13:34,707 INFO [RS:0;jenkins-hbase17:41721] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 13:13:34,708 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/WALs/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:34,710 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,41721,1689167613545] 2023-07-12 13:13:34,711 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:13:34,713 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62256101, jitterRate=-0.07231180369853973}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:13:34,713 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 13:13:34,713 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 13:13:34,714 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 13:13:34,714 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 13:13:34,714 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 13:13:34,714 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 13:13:34,715 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 13:13:34,715 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 13:13:34,721 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 13:13:34,721 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 13:13:34,723 DEBUG [RS:0;jenkins-hbase17:41721] zookeeper.ZKUtil(162): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:34,731 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 13:13:34,735 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 13:13:34,745 INFO [RS:0;jenkins-hbase17:41721] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 13:13:34,746 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 13:13:34,749 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 13:13:34,765 INFO [RS:0;jenkins-hbase17:41721] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 13:13:34,768 INFO [RS:0;jenkins-hbase17:41721] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:13:34,769 INFO [RS:0;jenkins-hbase17:41721] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:13:34,770 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 13:13:34,778 INFO [RS:0;jenkins-hbase17:41721] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-07-12 13:13:34,778 DEBUG [RS:0;jenkins-hbase17:41721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:13:34,778 DEBUG [RS:0;jenkins-hbase17:41721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:13:34,779 DEBUG [RS:0;jenkins-hbase17:41721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:13:34,779 DEBUG [RS:0;jenkins-hbase17:41721] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:13:34,779 DEBUG [RS:0;jenkins-hbase17:41721] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:13:34,779 DEBUG [RS:0;jenkins-hbase17:41721] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-12 13:13:34,779 DEBUG [RS:0;jenkins-hbase17:41721] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:13:34,779 DEBUG [RS:0;jenkins-hbase17:41721] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:13:34,779 DEBUG [RS:0;jenkins-hbase17:41721] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:13:34,779 DEBUG [RS:0;jenkins-hbase17:41721] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:13:34,780 INFO [RS:0;jenkins-hbase17:41721] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 13:13:34,780 INFO [RS:0;jenkins-hbase17:41721] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 13:13:34,780 INFO [RS:0;jenkins-hbase17:41721] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 13:13:34,795 INFO [RS:0;jenkins-hbase17:41721] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 13:13:34,797 INFO [RS:0;jenkins-hbase17:41721] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,41721,1689167613545-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:13:34,811 INFO [RS:0;jenkins-hbase17:41721] regionserver.Replication(203): jenkins-hbase17.apache.org,41721,1689167613545 started 2023-07-12 13:13:34,811 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,41721,1689167613545, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:41721, sessionid=0x10159a9c1fc0001 2023-07-12 13:13:34,812 DEBUG [RS:0;jenkins-hbase17:41721] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 13:13:34,812 DEBUG [RS:0;jenkins-hbase17:41721] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:34,812 DEBUG [RS:0;jenkins-hbase17:41721] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,41721,1689167613545' 2023-07-12 13:13:34,812 DEBUG [RS:0;jenkins-hbase17:41721] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:34,813 DEBUG [RS:0;jenkins-hbase17:41721] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:34,813 DEBUG [RS:0;jenkins-hbase17:41721] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 13:13:34,813 DEBUG [RS:0;jenkins-hbase17:41721] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 13:13:34,813 DEBUG [RS:0;jenkins-hbase17:41721] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:34,813 DEBUG [RS:0;jenkins-hbase17:41721] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,41721,1689167613545' 2023-07-12 13:13:34,813 DEBUG [RS:0;jenkins-hbase17:41721] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 13:13:34,814 DEBUG [RS:0;jenkins-hbase17:41721] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 13:13:34,814 DEBUG [RS:0;jenkins-hbase17:41721] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 13:13:34,815 INFO [RS:0;jenkins-hbase17:41721] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 13:13:34,815 INFO [RS:0;jenkins-hbase17:41721] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 13:13:34,902 DEBUG [jenkins-hbase17:41307] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-12 13:13:34,906 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,41721,1689167613545, state=OPENING 2023-07-12 13:13:34,914 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 13:13:34,915 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:13:34,916 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 13:13:34,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:13:34,926 INFO [RS:0;jenkins-hbase17:41721] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C41721%2C1689167613545, suffix=, logDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/WALs/jenkins-hbase17.apache.org,41721,1689167613545, archiveDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/oldWALs, maxLogs=32 2023-07-12 13:13:34,946 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45429,DS-59b01272-2dec-4e5d-852c-8f37aeee640e,DISK] 2023-07-12 13:13:34,949 INFO [RS:0;jenkins-hbase17:41721] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/WALs/jenkins-hbase17.apache.org,41721,1689167613545/jenkins-hbase17.apache.org%2C41721%2C1689167613545.1689167614930 2023-07-12 13:13:34,950 DEBUG [RS:0;jenkins-hbase17:41721] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45429,DS-59b01272-2dec-4e5d-852c-8f37aeee640e,DISK]] 2023-07-12 13:13:35,102 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:35,104 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 13:13:35,108 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:47810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 13:13:35,122 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 13:13:35,123 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 13:13:35,127 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C41721%2C1689167613545.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/WALs/jenkins-hbase17.apache.org,41721,1689167613545, archiveDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/oldWALs, maxLogs=32 2023-07-12 13:13:35,146 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45429,DS-59b01272-2dec-4e5d-852c-8f37aeee640e,DISK] 2023-07-12 13:13:35,165 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/WALs/jenkins-hbase17.apache.org,41721,1689167613545/jenkins-hbase17.apache.org%2C41721%2C1689167613545.meta.1689167615130.meta 2023-07-12 13:13:35,166 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45429,DS-59b01272-2dec-4e5d-852c-8f37aeee640e,DISK]] 2023-07-12 13:13:35,166 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:13:35,168 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 13:13:35,189 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 13:13:35,194 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 13:13:35,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 13:13:35,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:13:35,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 13:13:35,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 13:13:35,204 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 13:13:35,205 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/info 2023-07-12 13:13:35,206 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/info 2023-07-12 13:13:35,206 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 13:13:35,207 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:13:35,207 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 13:13:35,209 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/rep_barrier 2023-07-12 13:13:35,209 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/rep_barrier 2023-07-12 13:13:35,209 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 13:13:35,210 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:13:35,210 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 13:13:35,212 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/table 2023-07-12 13:13:35,212 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/table 2023-07-12 13:13:35,213 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 13:13:35,213 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:13:35,216 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740 2023-07-12 13:13:35,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740 2023-07-12 13:13:35,222 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:13:35,225 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 13:13:35,227 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64765597, jitterRate=-0.034917399287223816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:13:35,227 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 13:13:35,239 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689167615095 2023-07-12 13:13:35,255 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 13:13:35,256 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 13:13:35,257 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,41721,1689167613545, state=OPEN 2023-07-12 13:13:35,259 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 13:13:35,259 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 13:13:35,264 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 13:13:35,264 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,41721,1689167613545 in 340 msec 2023-07-12 13:13:35,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 13:13:35,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 535 msec 2023-07-12 13:13:35,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 763 msec 2023-07-12 13:13:35,276 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689167615276, completionTime=-1 2023-07-12 13:13:35,277 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-12 13:13:35,277 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 13:13:35,345 DEBUG [hconnection-0x3a038a2f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:13:35,349 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:47822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:13:35,369 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-12 13:13:35,369 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689167675369 2023-07-12 13:13:35,370 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689167735370 2023-07-12 13:13:35,370 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 92 msec 2023-07-12 13:13:35,391 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,41307,1689167612472-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:13:35,391 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,41307,1689167612472-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 13:13:35,392 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,41307,1689167612472-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 13:13:35,393 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:41307, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 13:13:35,393 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 13:13:35,399 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 13:13:35,407 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 13:13:35,409 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 13:13:35,418 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 13:13:35,420 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:13:35,423 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:13:35,445 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/hbase/namespace/ca4cc2441077e8f17b6c92a4389107ba 2023-07-12 13:13:35,448 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/hbase/namespace/ca4cc2441077e8f17b6c92a4389107ba empty. 2023-07-12 13:13:35,449 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/hbase/namespace/ca4cc2441077e8f17b6c92a4389107ba 2023-07-12 13:13:35,449 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 13:13:35,877 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 13:13:35,879 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => ca4cc2441077e8f17b6c92a4389107ba, NAME => 'hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:13:36,293 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:13:36,293 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing ca4cc2441077e8f17b6c92a4389107ba, disabling compactions & flushes 2023-07-12 13:13:36,293 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba. 2023-07-12 13:13:36,293 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba. 2023-07-12 13:13:36,293 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba. after waiting 0 ms 2023-07-12 13:13:36,293 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba. 2023-07-12 13:13:36,293 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba. 2023-07-12 13:13:36,293 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for ca4cc2441077e8f17b6c92a4389107ba: 2023-07-12 13:13:36,299 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:13:36,313 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689167616302"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167616302"}]},"ts":"1689167616302"} 2023-07-12 13:13:36,340 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 13:13:36,342 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:13:36,347 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167616343"}]},"ts":"1689167616343"} 2023-07-12 13:13:36,352 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 13:13:36,359 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ca4cc2441077e8f17b6c92a4389107ba, ASSIGN}] 2023-07-12 13:13:36,363 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ca4cc2441077e8f17b6c92a4389107ba, ASSIGN 2023-07-12 13:13:36,365 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ca4cc2441077e8f17b6c92a4389107ba, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:13:36,516 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ca4cc2441077e8f17b6c92a4389107ba, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:36,517 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689167616516"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167616516"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167616516"}]},"ts":"1689167616516"} 2023-07-12 13:13:36,524 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ca4cc2441077e8f17b6c92a4389107ba, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:13:36,689 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba. 2023-07-12 13:13:36,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca4cc2441077e8f17b6c92a4389107ba, NAME => 'hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:13:36,691 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ca4cc2441077e8f17b6c92a4389107ba 2023-07-12 13:13:36,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:13:36,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for ca4cc2441077e8f17b6c92a4389107ba 2023-07-12 13:13:36,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for ca4cc2441077e8f17b6c92a4389107ba 2023-07-12 13:13:36,694 INFO [StoreOpener-ca4cc2441077e8f17b6c92a4389107ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ca4cc2441077e8f17b6c92a4389107ba 2023-07-12 13:13:36,697 DEBUG [StoreOpener-ca4cc2441077e8f17b6c92a4389107ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/namespace/ca4cc2441077e8f17b6c92a4389107ba/info 2023-07-12 13:13:36,697 DEBUG [StoreOpener-ca4cc2441077e8f17b6c92a4389107ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/namespace/ca4cc2441077e8f17b6c92a4389107ba/info 2023-07-12 13:13:36,698 INFO [StoreOpener-ca4cc2441077e8f17b6c92a4389107ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca4cc2441077e8f17b6c92a4389107ba columnFamilyName info 2023-07-12 13:13:36,699 INFO [StoreOpener-ca4cc2441077e8f17b6c92a4389107ba-1] regionserver.HStore(310): Store=ca4cc2441077e8f17b6c92a4389107ba/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:13:36,701 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/namespace/ca4cc2441077e8f17b6c92a4389107ba 2023-07-12 13:13:36,702 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/namespace/ca4cc2441077e8f17b6c92a4389107ba 2023-07-12 13:13:36,709 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for ca4cc2441077e8f17b6c92a4389107ba 2023-07-12 13:13:36,714 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/namespace/ca4cc2441077e8f17b6c92a4389107ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:13:36,715 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened ca4cc2441077e8f17b6c92a4389107ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66280266, jitterRate=-0.01234707236289978}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:13:36,715 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for ca4cc2441077e8f17b6c92a4389107ba: 2023-07-12 13:13:36,717 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba., pid=6, masterSystemTime=1689167616680 2023-07-12 13:13:36,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba. 2023-07-12 13:13:36,722 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba. 2023-07-12 13:13:36,723 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ca4cc2441077e8f17b6c92a4389107ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:36,724 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689167616723"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167616723"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167616723"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167616723"}]},"ts":"1689167616723"} 2023-07-12 13:13:36,732 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 13:13:36,732 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ca4cc2441077e8f17b6c92a4389107ba, server=jenkins-hbase17.apache.org,41721,1689167613545 in 204 msec 2023-07-12 13:13:36,737 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 13:13:36,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ca4cc2441077e8f17b6c92a4389107ba, ASSIGN in 373 msec 2023-07-12 13:13:36,739 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:13:36,739 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167616739"}]},"ts":"1689167616739"} 2023-07-12 13:13:36,743 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 13:13:36,747 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:13:36,750 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3380 sec 2023-07-12 13:13:36,821 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 13:13:36,822 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 13:13:36,822 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:13:36,867 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 13:13:36,885 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 13:13:36,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-07-12 13:13:36,902 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 13:13:36,916 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 13:13:36,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-12 13:13:36,928 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 13:13:36,930 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 13:13:36,932 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.258sec 2023-07-12 13:13:36,933 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 13:13:36,935 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 13:13:36,935 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 13:13:36,936 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,41307,1689167612472-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 13:13:36,936 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,41307,1689167612472-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 13:13:36,949 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 13:13:37,020 DEBUG [Listener at localhost.localdomain/44505] zookeeper.ReadOnlyZKClient(139): Connect 0x6ce7946e to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:13:37,024 DEBUG [Listener at localhost.localdomain/44505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@666136dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:13:37,035 DEBUG [hconnection-0x1a08b70d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:13:37,045 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:47838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:13:37,054 INFO [Listener at localhost.localdomain/44505] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,41307,1689167612472 2023-07-12 13:13:37,054 DEBUG [Listener at localhost.localdomain/44505] zookeeper.ReadOnlyZKClient(139): Connect 0x4939d43d to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:13:37,059 DEBUG [Listener at localhost.localdomain/44505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19beb143, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:13:37,059 INFO [Listener at localhost.localdomain/44505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:13:37,082 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=212, OpenFileDescriptor=478, MaxFileDescriptor=60000, SystemLoadAverage=310, ProcessCount=168, AvailableMemoryMB=8232 2023-07-12 13:13:37,095 DEBUG [Listener at localhost.localdomain/44505] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:13:37,098 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:13:37,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-12 13:13:37,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:37,115 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:13:37,117 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:13:37,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-07-12 13:13:37,120 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831 2023-07-12 13:13:37,121 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831 empty. 2023-07-12 13:13:37,123 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831 2023-07-12 13:13:37,124 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-07-12 13:13:37,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 13:13:37,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 13:13:37,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 13:13:37,546 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-07-12 13:13:37,549 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => c46245c314248bd04561756602a12831, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:13:37,563 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:13:37,564 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing c46245c314248bd04561756602a12831, disabling compactions & flushes 2023-07-12 13:13:37,564 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:37,564 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:37,564 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. after waiting 0 ms 2023-07-12 13:13:37,564 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:37,564 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:37,564 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:37,570 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:13:37,572 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689167617572"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167617572"}]},"ts":"1689167617572"} 2023-07-12 13:13:37,574 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 13:13:37,576 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:13:37,576 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167617576"}]},"ts":"1689167617576"} 2023-07-12 13:13:37,578 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-07-12 13:13:37,581 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c46245c314248bd04561756602a12831, ASSIGN}] 2023-07-12 13:13:37,584 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c46245c314248bd04561756602a12831, ASSIGN 2023-07-12 13:13:37,586 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c46245c314248bd04561756602a12831, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:13:37,738 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c46245c314248bd04561756602a12831, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:37,739 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689167617737"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167617737"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167617737"}]},"ts":"1689167617737"} 2023-07-12 13:13:37,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 13:13:37,745 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure c46245c314248bd04561756602a12831, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:13:37,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:37,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c46245c314248bd04561756602a12831, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:13:37,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly c46245c314248bd04561756602a12831 2023-07-12 13:13:37,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:13:37,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for c46245c314248bd04561756602a12831 2023-07-12 13:13:37,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for c46245c314248bd04561756602a12831 2023-07-12 13:13:37,915 INFO [StoreOpener-c46245c314248bd04561756602a12831-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c46245c314248bd04561756602a12831 2023-07-12 13:13:37,918 DEBUG [StoreOpener-c46245c314248bd04561756602a12831-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1 2023-07-12 13:13:37,918 DEBUG [StoreOpener-c46245c314248bd04561756602a12831-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1 2023-07-12 13:13:37,922 INFO [StoreOpener-c46245c314248bd04561756602a12831-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c46245c314248bd04561756602a12831 columnFamilyName family1 2023-07-12 13:13:37,926 INFO [StoreOpener-c46245c314248bd04561756602a12831-1] regionserver.HStore(310): Store=c46245c314248bd04561756602a12831/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:13:37,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831 2023-07-12 13:13:37,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831 2023-07-12 13:13:37,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for c46245c314248bd04561756602a12831 2023-07-12 13:13:37,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:13:37,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened c46245c314248bd04561756602a12831; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69759469, jitterRate=0.03949709236621857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:13:37,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:37,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831., pid=11, masterSystemTime=1689167617899 2023-07-12 13:13:37,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:37,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:37,947 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c46245c314248bd04561756602a12831, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:37,947 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689167617947"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167617947"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167617947"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167617947"}]},"ts":"1689167617947"} 2023-07-12 13:13:37,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 13:13:37,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure c46245c314248bd04561756602a12831, server=jenkins-hbase17.apache.org,41721,1689167613545 in 205 msec 2023-07-12 13:13:37,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 13:13:37,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c46245c314248bd04561756602a12831, ASSIGN in 373 msec 2023-07-12 13:13:37,958 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:13:37,959 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167617958"}]},"ts":"1689167617958"} 2023-07-12 13:13:37,961 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-07-12 13:13:37,963 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:13:37,966 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 852 msec 2023-07-12 13:13:38,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 13:13:38,250 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-07-12 13:13:38,272 DEBUG [hconnection-0x4becdb3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:13:38,275 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:13:38,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:38,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:38,428 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:38,428 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:38,429 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-12 13:13:38,429 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-12 13:13:38,430 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:38,430 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:38,431 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:38,431 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:38,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:38,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:38,431 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:38,431 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:38,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:38,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:38,433 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:38,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:38,435 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-12 13:13:38,435 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:38,435 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-12 13:13:38,436 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:38,436 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:38,436 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:38,436 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. started... 2023-07-12 13:13:38,437 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c46245c314248bd04561756602a12831 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-12 13:13:39,002 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305faa82d86fa44f2185b131df01d167b0 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511305faa82d86fa44f2185b131df01d167b0 2023-07-12 13:13:39,419 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/b874d015e4504691b863ab72bb7ac4e6 2023-07-12 13:13:39,437 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/b874d015e4504691b863ab72bb7ac4e6 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/b874d015e4504691b863ab72bb7ac4e6 2023-07-12 13:13:39,446 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/b874d015e4504691b863ab72bb7ac4e6, entries=1000, sequenceid=5, filesize=175.8 K 2023-07-12 13:13:39,449 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c46245c314248bd04561756602a12831 in 1012ms, sequenceid=5, compaction requested=false 2023-07-12 13:13:39,450 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:39,454 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:39,454 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:39,454 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:39,454 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:39,454 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,455 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-12 13:13:39,455 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-12 13:13:39,457 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,457 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:39,458 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,458 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:39,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:39,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-12 13:13:39,460 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-12 13:13:39,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53175151[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:39,460 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,461 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,461 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-12 13:13:39,461 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-12 13:13:39,461 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:39,461 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,461 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:39,463 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,463 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-12 13:13:39,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:39,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:39,463 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:39,463 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-12 13:13:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:39,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-12 13:13:39,468 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-12 13:13:39,469 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:39,469 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:39,469 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,469 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:39,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:39,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:39,472 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,474 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,481 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,481 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:39,481 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:39,482 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,482 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:39,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:39,482 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,482 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:39,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:39,482 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:39,482 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,482 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:39,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:39,484 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:39,484 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:39,584 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:39,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:39,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:39,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:39,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,608 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:39,608 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:39,608 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-12 13:13:39,608 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-12 13:13:39,609 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,609 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,610 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:39,610 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:39,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:39,611 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:39,611 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:39,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:39,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,613 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,613 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-12 13:13:39,613 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:39,613 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-12 13:13:39,613 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:39,614 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-12 13:13:39,614 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:39,614 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:39,614 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:39,614 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. started... 2023-07-12 13:13:39,614 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c46245c314248bd04561756602a12831 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-12 13:13:40,051 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280e098e437151485495570c976be5040c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511280e098e437151485495570c976be5040c 2023-07-12 13:13:40,466 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/f6d79e8c8a064b7a8a2b92873f374dbe 2023-07-12 13:13:40,477 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/f6d79e8c8a064b7a8a2b92873f374dbe as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/f6d79e8c8a064b7a8a2b92873f374dbe 2023-07-12 13:13:40,485 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/f6d79e8c8a064b7a8a2b92873f374dbe, entries=1, sequenceid=9, filesize=5.0 K 2023-07-12 13:13:40,486 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c46245c314248bd04561756602a12831 in 872ms, sequenceid=9, compaction requested=false 2023-07-12 13:13:40,487 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:40,487 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:40,487 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:40,487 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:40,487 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,487 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-12 13:13:40,487 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-12 13:13:40,489 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,489 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:40,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:40,489 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,489 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:40,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:40,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:40,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:40,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-12 13:13:40,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12096934[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:40,491 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-12 13:13:40,491 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,492 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,492 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-12 13:13:40,492 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-12 13:13:40,492 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:40,493 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,493 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:40,495 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,495 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-12 13:13:40,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:40,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:40,495 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:40,496 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-12 13:13:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:40,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-12 13:13:40,499 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-12 13:13:40,499 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:40,499 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:40,499 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,499 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:40,501 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,501 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:40,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:40,501 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:40,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:40,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:40,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:40,502 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:40,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,504 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:40,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,507 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,507 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,507 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:40,507 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:40,508 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,508 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:40,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:40,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:40,508 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,508 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,508 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,508 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:40,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:40,509 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:40,509 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:40,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:40,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:40,609 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:40,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:40,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:40,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:40,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,627 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:40,627 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:40,628 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-12 13:13:40,628 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-12 13:13:40,629 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,629 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,630 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:40,630 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:40,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:40,631 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:40,631 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:40,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:40,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,632 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,633 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-12 13:13:40,633 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:40,633 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-12 13:13:40,633 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:40,633 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-12 13:13:40,633 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:40,633 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:40,633 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:40,634 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. started... 2023-07-12 13:13:40,634 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c46245c314248bd04561756602a12831 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:40,714 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 13:13:40,769 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 13:13:40,770 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 13:13:41,071 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201dd2ce11981874f81b5041cc93a08c454 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201dd2ce11981874f81b5041cc93a08c454 2023-07-12 13:13:41,487 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/a4f37144994f49c391701186f63cf4c4 2023-07-12 13:13:41,503 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/a4f37144994f49c391701186f63cf4c4 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/a4f37144994f49c391701186f63cf4c4 2023-07-12 13:13:41,515 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/a4f37144994f49c391701186f63cf4c4, entries=1, sequenceid=13, filesize=5.0 K 2023-07-12 13:13:41,516 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c46245c314248bd04561756602a12831 in 882ms, sequenceid=13, compaction requested=true 2023-07-12 13:13:41,516 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:41,516 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:41,516 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:41,517 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:41,517 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,517 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-12 13:13:41,517 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-12 13:13:41,519 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,519 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:41,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:41,520 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,520 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:41,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:41,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:41,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:41,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-12 13:13:41,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a19f258[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:41,522 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-12 13:13:41,522 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,523 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,523 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-12 13:13:41,524 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-12 13:13:41,524 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:41,524 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,524 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:41,525 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,525 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-12 13:13:41,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:41,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:41,525 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:41,525 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-12 13:13:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:41,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:41,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-12 13:13:41,529 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-12 13:13:41,529 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:41,529 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:41,529 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,529 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:41,531 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,531 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:41,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,531 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:41,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:41,531 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,533 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:41,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,536 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:41,536 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,536 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:41,536 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:41,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:41,537 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:41,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:41,537 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:41,537 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,537 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:41,537 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:41,537 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,538 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:41,538 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:41,638 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:41,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:41,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:41,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:41,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,656 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:41,656 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:41,656 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-12 13:13:41,656 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-12 13:13:41,657 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,657 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,658 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:41,658 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:41,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:41,659 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:41,659 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:41,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:41,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,660 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,660 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-12 13:13:41,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:41,660 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-12 13:13:41,660 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:41,660 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-12 13:13:41,661 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:41,661 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:41,661 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:41,661 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. started... 2023-07-12 13:13:41,661 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c46245c314248bd04561756602a12831 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:42,097 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120531e98866e6e84800a9db2604f38b3c47 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120531e98866e6e84800a9db2604f38b3c47 2023-07-12 13:13:42,515 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/e809235fb0994528a2f2194ae4c9425d 2023-07-12 13:13:42,532 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/e809235fb0994528a2f2194ae4c9425d as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/e809235fb0994528a2f2194ae4c9425d 2023-07-12 13:13:42,541 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/e809235fb0994528a2f2194ae4c9425d, entries=1, sequenceid=17, filesize=5.0 K 2023-07-12 13:13:42,542 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c46245c314248bd04561756602a12831 in 881ms, sequenceid=17, compaction requested=true 2023-07-12 13:13:42,543 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:42,543 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:42,543 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:42,543 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:42,543 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,543 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-12 13:13:42,543 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-12 13:13:42,545 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,545 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:42,546 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:42,546 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:42,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:42,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:42,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-12 13:13:42,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7dbb4bf8[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:42,547 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-12 13:13:42,547 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,548 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,548 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-12 13:13:42,548 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-12 13:13:42,548 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:42,548 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,548 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:42,550 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,550 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-12 13:13:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:42,550 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:42,550 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-12 13:13:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:42,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:42,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-12 13:13:42,553 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-12 13:13:42,553 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:42,553 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:42,553 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,553 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:42,554 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,554 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:42,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,554 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:42,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:42,555 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:42,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:42,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,557 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:42,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,561 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,561 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:42,561 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:42,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:42,561 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:42,561 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,561 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:42,561 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-12 13:13:42,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:42,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:42,561 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:42,561 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:42,562 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,562 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:42,562 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:42,606 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 13:13:42,608 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 13:13:42,662 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:42,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:42,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:42,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:42,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,681 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:42,681 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:42,681 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-12 13:13:42,681 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-12 13:13:42,682 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,682 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,683 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:42,683 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:42,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:42,684 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:42,684 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:42,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:42,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,685 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,685 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-12 13:13:42,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:42,685 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-12 13:13:42,685 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:42,686 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-12 13:13:42,686 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:42,686 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:42,686 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:42,686 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. started... 2023-07-12 13:13:42,686 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c46245c314248bd04561756602a12831 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:43,116 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228b93653af25514cbe916da309b1891915 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228b93653af25514cbe916da309b1891915 2023-07-12 13:13:43,530 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/a56bbe4787004944b5d303c497f38644 2023-07-12 13:13:43,538 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/a56bbe4787004944b5d303c497f38644 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/a56bbe4787004944b5d303c497f38644 2023-07-12 13:13:43,546 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/a56bbe4787004944b5d303c497f38644, entries=1, sequenceid=21, filesize=5.0 K 2023-07-12 13:13:43,547 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c46245c314248bd04561756602a12831 in 861ms, sequenceid=21, compaction requested=true 2023-07-12 13:13:43,547 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:43,547 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:43,547 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:43,548 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:43,548 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,548 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-12 13:13:43,548 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-12 13:13:43,550 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,551 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:43,551 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,551 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:43,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-12 13:13:43,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14cf10c7[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:43,553 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-12 13:13:43,553 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,554 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,554 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-12 13:13:43,554 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-12 13:13:43,554 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:43,554 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,554 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:43,555 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-12 13:13:43,555 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,555 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:43,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:43,555 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-12 13:13:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:43,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-12 13:13:43,558 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-12 13:13:43,558 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:43,558 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:43,558 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,558 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:43,559 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,559 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:43,560 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:43,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:43,560 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:43,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,562 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:43,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,564 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,564 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:43,564 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:43,564 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:43,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:43,564 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:43,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:43,564 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:43,564 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,565 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:43,565 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,565 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,565 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:43,565 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:43,666 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:43,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:43,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:43,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:43,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,677 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:43,677 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:43,678 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-12 13:13:43,678 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-12 13:13:43,678 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,679 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,680 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,680 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:43,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:43,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:43,680 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:43,680 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:43,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:43,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,681 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,682 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-12 13:13:43,682 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:43,682 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-12 13:13:43,682 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:43,682 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-12 13:13:43,683 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:43,683 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:43,683 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:43,683 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. started... 2023-07-12 13:13:43,683 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c46245c314248bd04561756602a12831 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:44,112 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310d704822158347dfb1bef8b4e18ab7be to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512310d704822158347dfb1bef8b4e18ab7be 2023-07-12 13:13:44,523 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/224024331cc14f81bee67540f36e213a 2023-07-12 13:13:44,538 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/224024331cc14f81bee67540f36e213a as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/224024331cc14f81bee67540f36e213a 2023-07-12 13:13:44,546 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/224024331cc14f81bee67540f36e213a, entries=1, sequenceid=25, filesize=5.0 K 2023-07-12 13:13:44,547 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c46245c314248bd04561756602a12831 in 864ms, sequenceid=25, compaction requested=true 2023-07-12 13:13:44,547 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:44,547 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:44,548 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:44,548 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:44,548 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,548 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-12 13:13:44,548 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-12 13:13:44,550 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,550 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:44,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:44,550 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,550 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:44,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:44,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:44,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:44,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-12 13:13:44,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dd69ba3[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:44,552 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-12 13:13:44,552 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,552 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,553 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-12 13:13:44,553 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,553 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:44,553 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-12 13:13:44,553 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:44,554 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,554 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-12 13:13:44,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:44,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:44,554 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:44,554 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-12 13:13:44,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:44,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:44,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:44,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:44,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-12 13:13:44,557 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-12 13:13:44,557 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:44,557 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:44,557 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,557 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:44,558 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,558 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:44,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,558 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:44,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:44,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:44,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:44,559 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:44,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:44,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,560 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:44,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,562 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,562 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:44,562 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:44,562 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:44,563 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:44,563 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,563 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:44,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-12 13:13:44,563 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:44,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:44,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:44,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:44,563 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,564 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,564 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:44,564 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:44,664 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:44,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:44,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:44,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:44,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,680 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:44,680 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:44,681 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-12 13:13:44,681 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-12 13:13:44,681 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,682 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,683 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,683 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:44,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:44,683 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:44,683 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:44,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,685 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,685 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-12 13:13:44,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:44,685 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-12 13:13:44,686 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:44,686 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-12 13:13:44,686 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:44,686 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:44,686 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:44,687 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. started... 2023-07-12 13:13:44,687 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c46245c314248bd04561756602a12831 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:44,709 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f125975632fd420ebd815dc1d061151d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101f125975632fd420ebd815dc1d061151d 2023-07-12 13:13:45,119 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/8a884d97a6ec4fcfaabbc173894ea547 2023-07-12 13:13:45,136 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/8a884d97a6ec4fcfaabbc173894ea547 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/8a884d97a6ec4fcfaabbc173894ea547 2023-07-12 13:13:45,145 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/8a884d97a6ec4fcfaabbc173894ea547, entries=1, sequenceid=29, filesize=5.0 K 2023-07-12 13:13:45,146 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c46245c314248bd04561756602a12831 in 459ms, sequenceid=29, compaction requested=true 2023-07-12 13:13:45,146 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:45,147 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:45,147 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:45,147 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:45,147 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,147 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-12 13:13:45,147 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-12 13:13:45,149 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,149 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:45,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:45,150 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,150 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:45,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:45,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:45,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:45,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-12 13:13:45,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18882b73[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:45,152 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-12 13:13:45,152 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,153 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,153 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-12 13:13:45,153 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-12 13:13:45,153 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:45,153 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,153 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:45,154 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-12 13:13:45,154 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,154 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:45,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:45,154 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-12 13:13:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:45,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:45,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-12 13:13:45,158 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-12 13:13:45,159 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:45,159 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:45,159 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,159 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:45,160 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,160 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:45,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:45,160 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:45,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:45,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:45,161 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:45,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:45,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,162 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,166 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,166 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,166 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:45,166 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:45,167 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:45,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:45,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:45,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:45,167 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,167 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:45,167 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,168 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:45,168 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:45,168 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,168 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:45,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:45,268 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:45,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:45,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:45,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:45,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,289 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:45,289 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:45,290 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-12 13:13:45,290 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-12 13:13:45,290 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,290 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,291 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:45,291 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:45,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:45,292 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:45,292 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:45,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:45,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,294 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,294 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-12 13:13:45,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:45,294 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-12 13:13:45,294 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:45,295 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-12 13:13:45,295 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:45,295 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:45,295 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:45,295 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. started... 2023-07-12 13:13:45,295 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c46245c314248bd04561756602a12831 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:45,728 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031bcb938459a8402181dfaefe2f058e5a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031bcb938459a8402181dfaefe2f058e5a 2023-07-12 13:13:46,139 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/fc870013e3a84173be36c7351d90b709 2023-07-12 13:13:46,154 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/fc870013e3a84173be36c7351d90b709 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/fc870013e3a84173be36c7351d90b709 2023-07-12 13:13:46,161 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/fc870013e3a84173be36c7351d90b709, entries=1, sequenceid=33, filesize=5.0 K 2023-07-12 13:13:46,163 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c46245c314248bd04561756602a12831 in 868ms, sequenceid=33, compaction requested=true 2023-07-12 13:13:46,163 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:46,163 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:46,163 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:46,163 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:46,163 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,163 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-12 13:13:46,163 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-12 13:13:46,165 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,165 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:46,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:46,165 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,165 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:46,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:46,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:46,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:46,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-12 13:13:46,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f4b5711[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:46,167 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-12 13:13:46,167 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,167 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,168 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-12 13:13:46,168 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-12 13:13:46,168 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:46,168 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,168 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:46,169 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-12 13:13:46,169 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,169 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:46,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:46,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:46,169 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-12 13:13:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:46,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-12 13:13:46,172 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-12 13:13:46,172 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:46,172 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:46,172 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,172 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:46,173 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,173 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:46,173 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:46,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:46,174 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:46,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,175 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,177 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,178 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,178 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:46,178 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,178 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:46,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:46,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:46,178 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:46,178 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:46,178 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,178 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,178 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,179 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:46,179 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:46,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:46,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:46,279 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:46,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:46,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:46,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:46,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,299 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:46,299 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:46,300 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-12 13:13:46,300 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-12 13:13:46,301 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,301 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,302 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:46,302 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:46,303 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:46,303 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:46,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,305 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,305 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-12 13:13:46,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:46,307 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-12 13:13:46,307 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:46,307 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-12 13:13:46,308 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:46,308 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:46,308 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:46,308 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. started... 2023-07-12 13:13:46,308 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c46245c314248bd04561756602a12831 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:46,740 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074b7a9627d3444e9b91380ab5804c696d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509074b7a9627d3444e9b91380ab5804c696d 2023-07-12 13:13:47,151 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/f32c3ad08b6e40d3a62e2c25c83de0f5 2023-07-12 13:13:47,164 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/f32c3ad08b6e40d3a62e2c25c83de0f5 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/f32c3ad08b6e40d3a62e2c25c83de0f5 2023-07-12 13:13:47,171 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/f32c3ad08b6e40d3a62e2c25c83de0f5, entries=1, sequenceid=37, filesize=5.0 K 2023-07-12 13:13:47,172 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c46245c314248bd04561756602a12831 in 864ms, sequenceid=37, compaction requested=true 2023-07-12 13:13:47,173 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:47,173 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:47,173 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:47,173 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:47,173 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,173 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-12 13:13:47,173 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-12 13:13:47,175 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,175 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:47,175 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,175 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:47,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-12 13:13:47,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@536e2117[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:47,176 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-12 13:13:47,177 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,177 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,177 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-12 13:13:47,177 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-12 13:13:47,177 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:47,178 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,178 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:47,178 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,178 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-12 13:13:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:47,178 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:47,179 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-12 13:13:47,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:47,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:47,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-12 13:13:47,181 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-12 13:13:47,181 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:47,181 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:47,181 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,181 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:47,182 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,182 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:47,183 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:47,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:47,183 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,185 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,187 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,187 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:47,187 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:47,187 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:47,187 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:47,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:47,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:47,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:47,187 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,188 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,188 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,188 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,188 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,188 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:47,189 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:47,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:47,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:47,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-12 13:13:47,289 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:47,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:47,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:47,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:47,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,303 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:47,303 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:47,303 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-12 13:13:47,303 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-12 13:13:47,304 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,304 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,305 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:47,305 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:47,305 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,305 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,306 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,306 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-12 13:13:47,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,306 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-12 13:13:47,306 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:47,307 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-12 13:13:47,307 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:47,307 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:47,307 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:47,308 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. started... 2023-07-12 13:13:47,308 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c46245c314248bd04561756602a12831 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:47,334 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205619bd71740e4824833e640160f8147a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511205619bd71740e4824833e640160f8147a 2023-07-12 13:13:47,370 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/ea272374252543089542c531102e48f9 2023-07-12 13:13:47,379 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/ea272374252543089542c531102e48f9 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/ea272374252543089542c531102e48f9 2023-07-12 13:13:47,387 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/ea272374252543089542c531102e48f9, entries=1, sequenceid=41, filesize=5.0 K 2023-07-12 13:13:47,388 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c46245c314248bd04561756602a12831 in 80ms, sequenceid=41, compaction requested=true 2023-07-12 13:13:47,388 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:47,388 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:47,388 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:47,389 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:47,389 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,389 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-12 13:13:47,389 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-12 13:13:47,390 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,390 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:47,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:47,390 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,390 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:47,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:47,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:47,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:47,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-12 13:13:47,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a9cb35a[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:47,392 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-12 13:13:47,392 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,393 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,394 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-12 13:13:47,394 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-12 13:13:47,394 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:47,394 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,394 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:47,395 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-12 13:13:47,395 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,395 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:47,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:47,395 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-12 13:13:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:47,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-12 13:13:47,399 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-12 13:13:47,399 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:47,399 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:47,399 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,399 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:47,400 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,400 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:47,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,400 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:47,401 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:47,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,402 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:47,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,404 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:47,404 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:47,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:47,404 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-12 13:13:47,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:47,404 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:47,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-12 13:13:47,404 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,404 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,404 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:47,405 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:47,405 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,405 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:47,405 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:47,405 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:47,505 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:47,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:47,516 DEBUG [Listener at localhost.localdomain/44505] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 13:13:47,520 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50354, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 13:13:47,521 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:47,533 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-12 13:13:47,534 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-12 13:13:47,535 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:13:47,535 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168227535 2023-07-12 13:13:47,537 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-12 13:13:47,541 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-07-12 13:13:47,541 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-12 13:13:47,541 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x76c9a269 to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:13:47,545 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7525f6b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:13:47,547 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:48,024 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030555b608c52d4abe810623c14872d55e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601030555b608c52d4abe810623c14872d55e 2023-07-12 13:13:48,026 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-12 13:13:48,046 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:13:48,048 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:13:48,061 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:13:48,063 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:13:48,102 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/862452ec1d2545178d4136502b2e66d7 first=Optional[r3] last=Optional[r6] 2023-07-12 13:13:48,116 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/862452ec1d2545178d4136502b2e66d7}] 2023-07-12 13:13:48,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/862452ec1d2545178d4136502b2e66d7 for inclusion in c46245c314248bd04561756602a12831/family1 2023-07-12 13:13:48,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-12 13:13:48,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:13:48,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:48,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/862452ec1d2545178d4136502b2e66d7 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__uo1bl8f50ahsoims6rb2nhgpd5hed6qusg221jtiobnlovhlnfrb9iioc0btaurg/family1/862452ec1d2545178d4136502b2e66d7 2023-07-12 13:13:48,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__uo1bl8f50ahsoims6rb2nhgpd5hed6qusg221jtiobnlovhlnfrb9iioc0btaurg/family1/862452ec1d2545178d4136502b2e66d7 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/dcfcd9b7217b4ed0b4cd846f0323f106_SeqId_44_ 2023-07-12 13:13:48,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__uo1bl8f50ahsoims6rb2nhgpd5hed6qusg221jtiobnlovhlnfrb9iioc0btaurg/family1/862452ec1d2545178d4136502b2e66d7 into c46245c314248bd04561756602a12831/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/dcfcd9b7217b4ed0b4cd846f0323f106_SeqId_44_ - updating store file list. 2023-07-12 13:13:48,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/dcfcd9b7217b4ed0b4cd846f0323f106_SeqId_44_ into c46245c314248bd04561756602a12831/family1 2023-07-12 13:13:48,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__uo1bl8f50ahsoims6rb2nhgpd5hed6qusg221jtiobnlovhlnfrb9iioc0btaurg/family1/862452ec1d2545178d4136502b2e66d7 into c46245c314248bd04561756602a12831/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/dcfcd9b7217b4ed0b4cd846f0323f106_SeqId_44_) 2023-07-12 13:13:48,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__uo1bl8f50ahsoims6rb2nhgpd5hed6qusg221jtiobnlovhlnfrb9iioc0btaurg/family1/862452ec1d2545178d4136502b2e66d7 2023-07-12 13:13:48,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-12 13:13:48,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-12 13:13:48,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(1912): c46245c314248bd04561756602a12831/family1 is initiating minor compaction 2023-07-12 13:13:48,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@37bf892d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:13:48,174 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c46245c314248bd04561756602a12831/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:48,174 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/f6d79e8c8a064b7a8a2b92873f374dbe, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/a4f37144994f49c391701186f63cf4c4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/e809235fb0994528a2f2194ae4c9425d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/a56bbe4787004944b5d303c497f38644, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/224024331cc14f81bee67540f36e213a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/8a884d97a6ec4fcfaabbc173894ea547, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/fc870013e3a84173be36c7351d90b709, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/f32c3ad08b6e40d3a62e2c25c83de0f5, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/ea272374252543089542c531102e48f9, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/dcfcd9b7217b4ed0b4cd846f0323f106_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp, totalSize=50.2 K 2023-07-12 13:13:48,175 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting f6d79e8c8a064b7a8a2b92873f374dbe, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-12 13:13:48,175 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting a4f37144994f49c391701186f63cf4c4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-12 13:13:48,175 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting e809235fb0994528a2f2194ae4c9425d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-12 13:13:48,175 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting a56bbe4787004944b5d303c497f38644, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-12 13:13:48,176 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 224024331cc14f81bee67540f36e213a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-12 13:13:48,176 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 8a884d97a6ec4fcfaabbc173894ea547, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-12 13:13:48,176 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting fc870013e3a84173be36c7351d90b709, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-12 13:13:48,176 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting f32c3ad08b6e40d3a62e2c25c83de0f5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-12 13:13:48,176 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting ea272374252543089542c531102e48f9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-12 13:13:48,176 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting dcfcd9b7217b4ed0b4cd846f0323f106_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-12 13:13:48,192 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-12 13:13:48,194 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:13:48,201 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228b93653af25514cbe916da309b1891915 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228b93653af25514cbe916da309b1891915 2023-07-12 13:13:48,204 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512310d704822158347dfb1bef8b4e18ab7be to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512310d704822158347dfb1bef8b4e18ab7be 2023-07-12 13:13:48,206 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101f125975632fd420ebd815dc1d061151d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101f125975632fd420ebd815dc1d061151d 2023-07-12 13:13:48,208 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031bcb938459a8402181dfaefe2f058e5a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031bcb938459a8402181dfaefe2f058e5a 2023-07-12 13:13:48,209 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-07-12 13:13:48,209 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-12 13:13:48,209 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:48,209 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:48,209 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:48,209 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:48,209 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:48,210 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:48,210 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:48,210 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:48,256 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): c46245c314248bd04561756602a12831#family1#compaction#10 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:13:48,336 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a9c926bceaf84df0ad7160e95c361f71 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205a9c926bceaf84df0ad7160e95c361f71 2023-07-12 13:13:48,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-12 13:13:48,378 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/401b24a6d1284d0ea3f4570d946fe81c first=Optional[r00] last=Optional[r2] 2023-07-12 13:13:48,379 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/401b24a6d1284d0ea3f4570d946fe81c}] 2023-07-12 13:13:48,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/401b24a6d1284d0ea3f4570d946fe81c for inclusion in c46245c314248bd04561756602a12831/family1 2023-07-12 13:13:48,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-07-12 13:13:48,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:13:48,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:48,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/401b24a6d1284d0ea3f4570d946fe81c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q00o8dn6civhf3s4nemq8pnv69obghikcn6u9c5973ag3mik9p4te07avfh52kvc/family1/401b24a6d1284d0ea3f4570d946fe81c 2023-07-12 13:13:48,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q00o8dn6civhf3s4nemq8pnv69obghikcn6u9c5973ag3mik9p4te07avfh52kvc/family1/401b24a6d1284d0ea3f4570d946fe81c as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/941691c7d2b3461d956899b51bf306d6_SeqId_46_ 2023-07-12 13:13:48,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q00o8dn6civhf3s4nemq8pnv69obghikcn6u9c5973ag3mik9p4te07avfh52kvc/family1/401b24a6d1284d0ea3f4570d946fe81c into c46245c314248bd04561756602a12831/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/941691c7d2b3461d956899b51bf306d6_SeqId_46_ - updating store file list. 2023-07-12 13:13:48,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/941691c7d2b3461d956899b51bf306d6_SeqId_46_ into c46245c314248bd04561756602a12831/family1 2023-07-12 13:13:48,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q00o8dn6civhf3s4nemq8pnv69obghikcn6u9c5973ag3mik9p4te07avfh52kvc/family1/401b24a6d1284d0ea3f4570d946fe81c into c46245c314248bd04561756602a12831/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/941691c7d2b3461d956899b51bf306d6_SeqId_46_) 2023-07-12 13:13:48,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q00o8dn6civhf3s4nemq8pnv69obghikcn6u9c5973ag3mik9p4te07avfh52kvc/family1/401b24a6d1284d0ea3f4570d946fe81c 2023-07-12 13:13:48,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-12 13:13:48,406 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:13:48,408 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511305faa82d86fa44f2185b131df01d167b0 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511305faa82d86fa44f2185b131df01d167b0 2023-07-12 13:13:48,410 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201dd2ce11981874f81b5041cc93a08c454 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201dd2ce11981874f81b5041cc93a08c454 2023-07-12 13:13:48,412 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120531e98866e6e84800a9db2604f38b3c47 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120531e98866e6e84800a9db2604f38b3c47 2023-07-12 13:13:48,412 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-07-12 13:13:48,412 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-12 13:13:48,413 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:48,413 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-12 13:13:48,414 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:13:48,415 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-12 13:13:48,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 889 msec 2023-07-12 13:13:48,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$12(2454): Client=jenkins//136.243.18.41 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-12 13:13:48,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:48,694 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/764ab65d75d34740bec634224a98712d as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/764ab65d75d34740bec634224a98712d 2023-07-12 13:13:48,711 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c46245c314248bd04561756602a12831/family1 of c46245c314248bd04561756602a12831 into 764ab65d75d34740bec634224a98712d(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:13:48,711 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:48,713 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1689167628172; duration=0sec 2023-07-12 13:13:48,714 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:13:48,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/f6d79e8c8a064b7a8a2b92873f374dbe, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/a4f37144994f49c391701186f63cf4c4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/e809235fb0994528a2f2194ae4c9425d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/a56bbe4787004944b5d303c497f38644, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/224024331cc14f81bee67540f36e213a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/8a884d97a6ec4fcfaabbc173894ea547, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/fc870013e3a84173be36c7351d90b709, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/f32c3ad08b6e40d3a62e2c25c83de0f5, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/ea272374252543089542c531102e48f9, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/dcfcd9b7217b4ed0b4cd846f0323f106_SeqId_44_] to archive 2023-07-12 13:13:48,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:13:48,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/f6d79e8c8a064b7a8a2b92873f374dbe to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/f6d79e8c8a064b7a8a2b92873f374dbe 2023-07-12 13:13:48,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/a4f37144994f49c391701186f63cf4c4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/a4f37144994f49c391701186f63cf4c4 2023-07-12 13:13:48,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/e809235fb0994528a2f2194ae4c9425d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/e809235fb0994528a2f2194ae4c9425d 2023-07-12 13:13:48,801 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/a56bbe4787004944b5d303c497f38644 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/a56bbe4787004944b5d303c497f38644 2023-07-12 13:13:48,802 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/224024331cc14f81bee67540f36e213a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/224024331cc14f81bee67540f36e213a 2023-07-12 13:13:48,804 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/8a884d97a6ec4fcfaabbc173894ea547 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/8a884d97a6ec4fcfaabbc173894ea547 2023-07-12 13:13:48,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/fc870013e3a84173be36c7351d90b709 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/fc870013e3a84173be36c7351d90b709 2023-07-12 13:13:48,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/f32c3ad08b6e40d3a62e2c25c83de0f5 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/f32c3ad08b6e40d3a62e2c25c83de0f5 2023-07-12 13:13:48,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/ea272374252543089542c531102e48f9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/ea272374252543089542c531102e48f9 2023-07-12 13:13:48,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/dcfcd9b7217b4ed0b4cd846f0323f106_SeqId_44_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/dcfcd9b7217b4ed0b4cd846f0323f106_SeqId_44_ 2023-07-12 13:13:49,067 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-07-12 13:13:49,070 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-07-12 13:13:49,070 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-07-12 13:13:49,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-07-12 13:13:49,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c46245c314248bd04561756602a12831, REOPEN/MOVE}] 2023-07-12 13:13:49,094 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c46245c314248bd04561756602a12831, REOPEN/MOVE 2023-07-12 13:13:49,095 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c46245c314248bd04561756602a12831, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:49,095 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689167629094"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167629094"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167629094"}]},"ts":"1689167629094"} 2023-07-12 13:13:49,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure c46245c314248bd04561756602a12831, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:13:49,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close c46245c314248bd04561756602a12831 2023-07-12 13:13:49,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing c46245c314248bd04561756602a12831, disabling compactions & flushes 2023-07-12 13:13:49,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:49,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:49,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. after waiting 0 ms 2023-07-12 13:13:49,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:49,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-07-12 13:13:49,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:49,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:49,277 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(3510): Not adding moved region record: c46245c314248bd04561756602a12831 to self. 2023-07-12 13:13:49,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed c46245c314248bd04561756602a12831 2023-07-12 13:13:49,282 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c46245c314248bd04561756602a12831, regionState=CLOSED 2023-07-12 13:13:49,282 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689167629282"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167629282"}]},"ts":"1689167629282"} 2023-07-12 13:13:49,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-07-12 13:13:49,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure c46245c314248bd04561756602a12831, server=jenkins-hbase17.apache.org,41721,1689167613545 in 188 msec 2023-07-12 13:13:49,290 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c46245c314248bd04561756602a12831, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=true 2023-07-12 13:13:49,441 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c46245c314248bd04561756602a12831, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:49,441 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689167629441"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167629441"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167629441"}]},"ts":"1689167629441"} 2023-07-12 13:13:49,445 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure c46245c314248bd04561756602a12831, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:13:49,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:49,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c46245c314248bd04561756602a12831, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:13:49,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly c46245c314248bd04561756602a12831 2023-07-12 13:13:49,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:13:49,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for c46245c314248bd04561756602a12831 2023-07-12 13:13:49,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for c46245c314248bd04561756602a12831 2023-07-12 13:13:49,607 INFO [StoreOpener-c46245c314248bd04561756602a12831-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c46245c314248bd04561756602a12831 2023-07-12 13:13:49,609 DEBUG [StoreOpener-c46245c314248bd04561756602a12831-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1 2023-07-12 13:13:49,609 DEBUG [StoreOpener-c46245c314248bd04561756602a12831-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1 2023-07-12 13:13:49,610 INFO [StoreOpener-c46245c314248bd04561756602a12831-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c46245c314248bd04561756602a12831 columnFamilyName family1 2023-07-12 13:13:49,621 DEBUG [StoreOpener-c46245c314248bd04561756602a12831-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/764ab65d75d34740bec634224a98712d 2023-07-12 13:13:49,628 DEBUG [StoreOpener-c46245c314248bd04561756602a12831-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/941691c7d2b3461d956899b51bf306d6_SeqId_46_ 2023-07-12 13:13:49,634 DEBUG [StoreOpener-c46245c314248bd04561756602a12831-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/b874d015e4504691b863ab72bb7ac4e6 2023-07-12 13:13:49,634 INFO [StoreOpener-c46245c314248bd04561756602a12831-1] regionserver.HStore(310): Store=c46245c314248bd04561756602a12831/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:13:49,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831 2023-07-12 13:13:49,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831 2023-07-12 13:13:49,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for c46245c314248bd04561756602a12831 2023-07-12 13:13:49,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened c46245c314248bd04561756602a12831; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65902967, jitterRate=-0.017969265580177307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:13:49,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:49,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831., pid=17, masterSystemTime=1689167629599 2023-07-12 13:13:49,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:13:49,644 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 13:13:49,645 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 13:13:49,645 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1912): c46245c314248bd04561756602a12831/family1 is initiating minor compaction (all files) 2023-07-12 13:13:49,646 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c46245c314248bd04561756602a12831/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:49,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:49,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:13:49,646 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/b874d015e4504691b863ab72bb7ac4e6, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/764ab65d75d34740bec634224a98712d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/941691c7d2b3461d956899b51bf306d6_SeqId_46_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp, totalSize=358.6 K 2023-07-12 13:13:49,646 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c46245c314248bd04561756602a12831, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:49,646 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting b874d015e4504691b863ab72bb7ac4e6, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837060 2023-07-12 13:13:49,647 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689167629646"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167629646"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167629646"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167629646"}]},"ts":"1689167629646"} 2023-07-12 13:13:49,647 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 764ab65d75d34740bec634224a98712d, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237060 2023-07-12 13:13:49,648 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 941691c7d2b3461d956899b51bf306d6_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878837060 2023-07-12 13:13:49,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-07-12 13:13:49,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure c46245c314248bd04561756602a12831, server=jenkins-hbase17.apache.org,41721,1689167613545 in 205 msec 2023-07-12 13:13:49,656 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-12 13:13:49,656 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c46245c314248bd04561756602a12831, REOPEN/MOVE in 561 msec 2023-07-12 13:13:49,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-12 13:13:49,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 584 msec 2023-07-12 13:13:49,667 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0240 sec 2023-07-12 13:13:49,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-07-12 13:13:49,679 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(278): alter status finished 2023-07-12 13:13:49,680 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-12 13:13:49,683 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-12 13:13:49,684 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-12 13:13:49,685 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:13:49,685 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168229685 2023-07-12 13:13:49,686 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-12 13:13:49,687 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-07-12 13:13:49,687 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-12 13:13:49,688 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x253ac120 to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:13:49,704 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): c46245c314248bd04561756602a12831#family1#compaction#11 average throughput is 4.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:13:49,714 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d738b19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:13:49,714 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:49,714 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:49,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:49,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:49,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:49,757 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/.tmp/family1/e6127ab770bc4215b021c49ee81488f9 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/e6127ab770bc4215b021c49ee81488f9 2023-07-12 13:13:49,766 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c46245c314248bd04561756602a12831/family1 of c46245c314248bd04561756602a12831 into e6127ab770bc4215b021c49ee81488f9(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:13:49,766 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:49,766 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831., storeName=c46245c314248bd04561756602a12831/family1, priority=13, startTime=1689167629643; duration=0sec 2023-07-12 13:13:49,767 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:13:49,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/b874d015e4504691b863ab72bb7ac4e6, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/764ab65d75d34740bec634224a98712d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/941691c7d2b3461d956899b51bf306d6_SeqId_46_] to archive 2023-07-12 13:13:49,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:13:49,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/b874d015e4504691b863ab72bb7ac4e6 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/b874d015e4504691b863ab72bb7ac4e6 2023-07-12 13:13:49,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/764ab65d75d34740bec634224a98712d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/764ab65d75d34740bec634224a98712d 2023-07-12 13:13:49,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/941691c7d2b3461d956899b51bf306d6_SeqId_46_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/941691c7d2b3461d956899b51bf306d6_SeqId_46_ 2023-07-12 13:13:50,170 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c85cd817c58e4b6a805d030a79ad39f7 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128c85cd817c58e4b6a805d030a79ad39f7 2023-07-12 13:13:50,172 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-12 13:13:50,187 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:13:50,188 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:13:50,196 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:13:50,198 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:13:50,211 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0de6ca97189d4e0db70257806890f470 first=Optional[r05] last=Optional[r8] 2023-07-12 13:13:50,212 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=50 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0de6ca97189d4e0db70257806890f470}] 2023-07-12 13:13:50,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0de6ca97189d4e0db70257806890f470 for inclusion in c46245c314248bd04561756602a12831/family1 2023-07-12 13:13:50,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-07-12 13:13:50,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:13:50,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for c46245c314248bd04561756602a12831: 2023-07-12 13:13:50,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0de6ca97189d4e0db70257806890f470 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__huhvnmcrvlo7q3svhgvcjqkfml1dm8apu0numdbh1tmr8t4bli24073bm98bupk7/family1/0de6ca97189d4e0db70257806890f470 2023-07-12 13:13:50,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__huhvnmcrvlo7q3svhgvcjqkfml1dm8apu0numdbh1tmr8t4bli24073bm98bupk7/family1/0de6ca97189d4e0db70257806890f470 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/0c1bd067ae7d4c4ca7e8971c294f1476_SeqId_53_ 2023-07-12 13:13:50,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__huhvnmcrvlo7q3svhgvcjqkfml1dm8apu0numdbh1tmr8t4bli24073bm98bupk7/family1/0de6ca97189d4e0db70257806890f470 into c46245c314248bd04561756602a12831/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/0c1bd067ae7d4c4ca7e8971c294f1476_SeqId_53_ - updating store file list. 2023-07-12 13:13:50,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/0c1bd067ae7d4c4ca7e8971c294f1476_SeqId_53_ into c46245c314248bd04561756602a12831/family1 2023-07-12 13:13:50,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__huhvnmcrvlo7q3svhgvcjqkfml1dm8apu0numdbh1tmr8t4bli24073bm98bupk7/family1/0de6ca97189d4e0db70257806890f470 into c46245c314248bd04561756602a12831/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/family1/0c1bd067ae7d4c4ca7e8971c294f1476_SeqId_53_) 2023-07-12 13:13:50,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__huhvnmcrvlo7q3svhgvcjqkfml1dm8apu0numdbh1tmr8t4bli24073bm98bupk7/family1/0de6ca97189d4e0db70257806890f470 2023-07-12 13:13:50,237 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-12 13:13:50,238 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:13:50,240 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511205619bd71740e4824833e640160f8147a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511205619bd71740e4824833e640160f8147a 2023-07-12 13:13:50,241 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511280e098e437151485495570c976be5040c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511280e098e437151485495570c976be5040c 2023-07-12 13:13:50,241 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-07-12 13:13:50,241 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-12 13:13:50,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:50,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:50,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-12 13:13:50,242 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-12 13:13:50,242 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:13:50,243 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-12 13:13:50,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 561 msec 2023-07-12 13:13:50,356 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=252 (was 212) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:36202 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1136397898_17 at /127.0.0.1:58708 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70ceb3ee-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51470@0x253ac120 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/140944349.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:58750 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:36156 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/cluster_2e6eebf2-882c-9df6-f703-f5434d9a427a/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12fddfb8-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70ceb3ee-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51470@0x253ac120-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12fddfb8-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70ceb3ee-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:58676 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase17:41721-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:36212 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70ceb3ee-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:58740 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51470@0x76c9a269-SendThread(127.0.0.1:51470) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51470@0x253ac120-SendThread(127.0.0.1:51470) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:36170 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70ceb3ee-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12fddfb8-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:36284 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:58754 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51470@0x76c9a269 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/140944349.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:36184 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:58772 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:36276 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:36218 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:36142 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51470@0x76c9a269-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) - Thread LEAK? -, OpenFileDescriptor=597 (was 478) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 310), ProcessCount=168 (was 168), AvailableMemoryMB=8026 (was 8232) 2023-07-12 13:13:50,366 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=168, AvailableMemoryMB=8025 2023-07-12 13:13:50,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-12 13:13:50,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:50,372 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:13:50,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-07-12 13:13:50,373 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:13:50,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-12 13:13:50,375 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e 2023-07-12 13:13:50,375 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e empty. 2023-07-12 13:13:50,376 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e 2023-07-12 13:13:50,376 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-07-12 13:13:50,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-12 13:13:50,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-12 13:13:50,790 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-07-12 13:13:50,795 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => e60e2238d684b9eda52028c97b0e4a2e, NAME => 'testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:13:50,803 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:13:50,803 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing e60e2238d684b9eda52028c97b0e4a2e, disabling compactions & flushes 2023-07-12 13:13:50,803 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:50,803 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:50,803 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. after waiting 0 ms 2023-07-12 13:13:50,803 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:50,803 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:50,803 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:13:50,806 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:13:50,807 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689167630807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167630807"}]},"ts":"1689167630807"} 2023-07-12 13:13:50,809 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 13:13:50,811 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:13:50,811 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167630811"}]},"ts":"1689167630811"} 2023-07-12 13:13:50,813 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-07-12 13:13:50,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=e60e2238d684b9eda52028c97b0e4a2e, ASSIGN}] 2023-07-12 13:13:50,817 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=e60e2238d684b9eda52028c97b0e4a2e, ASSIGN 2023-07-12 13:13:50,817 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=e60e2238d684b9eda52028c97b0e4a2e, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:13:50,969 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e60e2238d684b9eda52028c97b0e4a2e, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:50,970 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689167630969"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167630969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167630969"}]},"ts":"1689167630969"} 2023-07-12 13:13:50,975 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure e60e2238d684b9eda52028c97b0e4a2e, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:13:50,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-12 13:13:51,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:51,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e60e2238d684b9eda52028c97b0e4a2e, NAME => 'testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:13:51,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy e60e2238d684b9eda52028c97b0e4a2e 2023-07-12 13:13:51,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:13:51,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e60e2238d684b9eda52028c97b0e4a2e 2023-07-12 13:13:51,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e60e2238d684b9eda52028c97b0e4a2e 2023-07-12 13:13:51,142 INFO [StoreOpener-e60e2238d684b9eda52028c97b0e4a2e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e60e2238d684b9eda52028c97b0e4a2e 2023-07-12 13:13:51,144 DEBUG [StoreOpener-e60e2238d684b9eda52028c97b0e4a2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1 2023-07-12 13:13:51,144 DEBUG [StoreOpener-e60e2238d684b9eda52028c97b0e4a2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1 2023-07-12 13:13:51,144 INFO [StoreOpener-e60e2238d684b9eda52028c97b0e4a2e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e60e2238d684b9eda52028c97b0e4a2e columnFamilyName family1 2023-07-12 13:13:51,147 INFO [StoreOpener-e60e2238d684b9eda52028c97b0e4a2e-1] regionserver.HStore(310): Store=e60e2238d684b9eda52028c97b0e4a2e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:13:51,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e 2023-07-12 13:13:51,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e 2023-07-12 13:13:51,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e60e2238d684b9eda52028c97b0e4a2e 2023-07-12 13:13:51,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:13:51,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e60e2238d684b9eda52028c97b0e4a2e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67434215, jitterRate=0.004848107695579529}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:13:51,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:13:51,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e., pid=21, masterSystemTime=1689167631130 2023-07-12 13:13:51,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:51,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:51,159 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e60e2238d684b9eda52028c97b0e4a2e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:51,159 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689167631159"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167631159"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167631159"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167631159"}]},"ts":"1689167631159"} 2023-07-12 13:13:51,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-07-12 13:13:51,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure e60e2238d684b9eda52028c97b0e4a2e, server=jenkins-hbase17.apache.org,41721,1689167613545 in 186 msec 2023-07-12 13:13:51,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-07-12 13:13:51,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=e60e2238d684b9eda52028c97b0e4a2e, ASSIGN in 349 msec 2023-07-12 13:13:51,167 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:13:51,167 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167631167"}]},"ts":"1689167631167"} 2023-07-12 13:13:51,169 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-07-12 13:13:51,171 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:13:51,173 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 802 msec 2023-07-12 13:13:51,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-12 13:13:51,484 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-07-12 13:13:51,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:51,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:51,532 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:51,532 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:51,533 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:13:51,533 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:13:51,533 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:51,533 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:51,534 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:51,534 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:51,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:51,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:51,535 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:51,535 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:51,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:51,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:51,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:51,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:51,536 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:51,536 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:51,536 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:13:51,536 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:51,536 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:13:51,537 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:51,537 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:51,537 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:51,537 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. started... 2023-07-12 13:13:51,537 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e60e2238d684b9eda52028c97b0e4a2e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-12 13:13:51,974 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ba2e05ccf525423f9ecc5d25da5594a9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ba2e05ccf525423f9ecc5d25da5594a9 2023-07-12 13:13:51,980 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/2fcb915f7c4a42ee940b2bcc6f070170 2023-07-12 13:13:51,988 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/2fcb915f7c4a42ee940b2bcc6f070170 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/2fcb915f7c4a42ee940b2bcc6f070170 2023-07-12 13:13:51,994 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/2fcb915f7c4a42ee940b2bcc6f070170, entries=1000, sequenceid=5, filesize=166.0 K 2023-07-12 13:13:51,995 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e60e2238d684b9eda52028c97b0e4a2e in 458ms, sequenceid=5, compaction requested=false 2023-07-12 13:13:51,995 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:51,996 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:13:51,996 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:51,996 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:51,996 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:51,996 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:51,996 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:13:51,996 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:13:51,997 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:51,997 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:51,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:51,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:51,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:51,998 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:51,998 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:51,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:51,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:51,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:51,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:51,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:51,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:13:51,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7396d6c9[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:51,999 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:13:51,999 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,000 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,000 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:13:52,000 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:13:52,000 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:52,000 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,000 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:52,001 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:13:52,001 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,001 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:52,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:52,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:52,001 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:13:52,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:52,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:52,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:13:52,005 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:13:52,005 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:52,005 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:52,005 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,005 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:52,006 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,006 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:52,006 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:52,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,007 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:52,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,008 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:52,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,010 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,010 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:52,010 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,010 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:52,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:52,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:52,010 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:52,010 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:52,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:52,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-12 13:13:52,011 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,011 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,011 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,011 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,011 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:52,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:52,011 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:52,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:52,111 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:52,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:52,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:52,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:52,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,125 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:52,125 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:52,125 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:13:52,125 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:13:52,126 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,126 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,127 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:52,127 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:52,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:52,128 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,128 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:52,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:52,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,129 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,129 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:13:52,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,129 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:13:52,129 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:52,130 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:13:52,130 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:52,130 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:52,130 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:52,130 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. started... 2023-07-12 13:13:52,130 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e60e2238d684b9eda52028c97b0e4a2e 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-12 13:13:52,558 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280907d26884354fd69567fb257a0febcc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511280907d26884354fd69567fb257a0febcc 2023-07-12 13:13:52,966 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/74fa0398057140cf959d66eb35c8b807 2023-07-12 13:13:52,981 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/74fa0398057140cf959d66eb35c8b807 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/74fa0398057140cf959d66eb35c8b807 2023-07-12 13:13:52,988 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/74fa0398057140cf959d66eb35c8b807, entries=1, sequenceid=9, filesize=5.0 K 2023-07-12 13:13:52,989 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e60e2238d684b9eda52028c97b0e4a2e in 859ms, sequenceid=9, compaction requested=false 2023-07-12 13:13:52,989 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:13:52,989 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:52,989 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:52,990 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:52,990 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,990 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:13:52,990 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:13:52,991 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,991 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:52,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:52,991 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,991 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:52,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:52,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:52,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:52,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:13:52,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1680e475[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:52,993 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:13:52,993 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,994 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,994 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:13:52,994 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:13:52,994 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:52,994 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,994 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:52,995 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:13:52,995 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:52,995 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,995 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:13:52,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:52,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:52,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:52,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:52,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:52,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:52,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:52,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:13:52,998 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:13:52,999 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:52,999 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:52,999 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:52,999 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:53,000 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,000 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,000 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:53,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:53,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:53,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:53,000 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:53,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:53,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:53,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,001 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,006 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,006 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,006 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:53,006 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:53,007 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-12 13:13:53,007 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:53,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:53,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:53,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:53,007 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:53,007 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,007 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,008 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,008 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,008 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:53,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:53,008 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:53,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:53,108 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:53,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:53,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:53,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:53,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,123 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:53,123 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:53,124 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:13:53,124 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:13:53,125 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,125 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,126 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,126 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:53,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:53,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:53,126 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,126 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:53,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:53,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,127 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,128 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:13:53,128 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,128 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:13:53,128 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:53,128 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:13:53,128 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:53,129 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:53,129 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:53,129 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. started... 2023-07-12 13:13:53,129 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e60e2238d684b9eda52028c97b0e4a2e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:53,548 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ef565c4932b643b7a1920c67dd987bf6 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ef565c4932b643b7a1920c67dd987bf6 2023-07-12 13:13:53,956 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/a3bee8b9c97e4d9db4cb4be659000ca2 2023-07-12 13:13:53,962 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/a3bee8b9c97e4d9db4cb4be659000ca2 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/a3bee8b9c97e4d9db4cb4be659000ca2 2023-07-12 13:13:53,968 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/a3bee8b9c97e4d9db4cb4be659000ca2, entries=1, sequenceid=13, filesize=4.9 K 2023-07-12 13:13:53,969 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e60e2238d684b9eda52028c97b0e4a2e in 840ms, sequenceid=13, compaction requested=true 2023-07-12 13:13:53,969 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:13:53,969 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:53,970 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:53,970 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:53,970 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,970 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:13:53,970 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:13:53,971 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,971 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:53,971 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,972 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:53,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:53,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:53,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:53,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:13:53,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3444192b[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:53,973 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:13:53,973 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,974 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,974 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:13:53,974 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,974 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:53,974 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:13:53,974 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:53,975 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:13:53,975 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,975 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:53,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:53,975 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:13:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:53,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:13:53,978 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:13:53,978 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:53,978 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:53,978 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,978 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:53,979 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,979 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:53,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,980 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:53,980 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,981 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,983 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,983 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,983 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:53,983 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:53,983 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:53,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:53,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:53,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:53,983 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:53,983 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:53,983 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:53,984 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:53,984 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:53,984 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:53,984 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:54,084 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:54,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:54,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:54,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:54,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:54,097 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:54,097 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:54,097 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:13:54,097 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:13:54,098 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:54,098 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:54,098 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:54,098 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:54,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:54,099 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:54,099 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:54,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:54,100 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:54,100 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:13:54,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:54,100 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:13:54,100 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:54,101 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:13:54,101 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:54,101 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:54,101 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:54,101 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. started... 2023-07-12 13:13:54,101 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e60e2238d684b9eda52028c97b0e4a2e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:54,524 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fb950bcf9c34490789c750c8acf01168 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205fb950bcf9c34490789c750c8acf01168 2023-07-12 13:13:54,812 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 13:13:54,931 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/6f0eaa45d73946f8b3fc4c0d3d747fba 2023-07-12 13:13:54,944 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/6f0eaa45d73946f8b3fc4c0d3d747fba as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/6f0eaa45d73946f8b3fc4c0d3d747fba 2023-07-12 13:13:54,952 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/6f0eaa45d73946f8b3fc4c0d3d747fba, entries=1, sequenceid=17, filesize=4.9 K 2023-07-12 13:13:54,953 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e60e2238d684b9eda52028c97b0e4a2e in 852ms, sequenceid=17, compaction requested=true 2023-07-12 13:13:54,953 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:13:54,953 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:54,953 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:54,953 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:54,953 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:54,953 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:13:54,953 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:13:55,103 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,103 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:55,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:55,104 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,104 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:55,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:55,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:55,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:13:55,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b8d6a9a[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:55,108 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:13:55,108 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,145 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,146 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:13:55,146 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:13:55,146 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:55,146 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,146 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:55,168 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:13:55,168 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:55,168 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,168 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:13:55,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:55,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:55,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:55,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:55,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:55,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:13:55,177 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:13:55,178 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:55,178 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:55,178 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,178 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:55,180 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,180 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:55,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,180 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:55,181 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:55,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,182 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:55,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,184 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:55,184 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:55,184 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,184 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:55,184 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:55,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:55,184 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:55,185 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,185 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,185 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,185 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,186 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:55,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:55,186 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:55,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:55,286 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:55,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:55,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:55,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:55,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,300 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:55,300 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:55,301 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:13:55,301 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:13:55,302 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,302 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,303 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,303 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:55,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:55,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:55,303 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:55,303 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:55,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,304 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,304 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:13:55,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:55,305 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:13:55,305 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:55,305 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:13:55,305 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:55,305 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:55,305 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:55,305 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. started... 2023-07-12 13:13:55,306 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e60e2238d684b9eda52028c97b0e4a2e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:55,729 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c1b0de722fe44454b36723849501b752 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228c1b0de722fe44454b36723849501b752 2023-07-12 13:13:56,137 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/24edb1653fd143dabcff188ce7bb38a6 2023-07-12 13:13:56,145 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/24edb1653fd143dabcff188ce7bb38a6 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/24edb1653fd143dabcff188ce7bb38a6 2023-07-12 13:13:56,152 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/24edb1653fd143dabcff188ce7bb38a6, entries=1, sequenceid=21, filesize=4.9 K 2023-07-12 13:13:56,153 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e60e2238d684b9eda52028c97b0e4a2e in 848ms, sequenceid=21, compaction requested=true 2023-07-12 13:13:56,153 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:13:56,153 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:56,153 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:56,153 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:56,153 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,153 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:13:56,153 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:13:56,155 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,155 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:56,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:56,155 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:56,155 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:56,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:56,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:56,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:13:56,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ee8dbbc[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:56,156 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:13:56,157 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,157 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,158 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:13:56,158 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:13:56,158 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,158 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:56,158 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:56,159 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:13:56,159 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,159 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:56,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:56,159 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:13:56,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:56,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:56,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:56,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:56,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:56,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:13:56,161 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:13:56,161 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:56,162 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:56,162 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,162 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:56,167 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,167 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:56,167 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:56,168 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,169 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,170 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,170 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:56,170 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:56,170 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:56,170 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:56,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:56,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:56,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:56,170 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,171 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,171 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,171 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,171 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,171 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:56,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:56,171 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:56,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:56,271 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:56,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:56,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:56,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:56,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,287 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:56,287 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:56,288 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:13:56,288 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:13:56,289 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,289 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,290 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,290 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:56,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:56,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:56,291 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:56,291 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:56,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:56,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,293 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,293 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:13:56,293 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:56,293 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:13:56,293 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:56,294 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:13:56,294 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:56,294 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:56,294 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:56,294 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. started... 2023-07-12 13:13:56,294 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e60e2238d684b9eda52028c97b0e4a2e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:56,719 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311cbe98bd6adf432781e11a996e641635 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512311cbe98bd6adf432781e11a996e641635 2023-07-12 13:13:57,128 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/0a031e8f783f4b15b7c8d629d62c180e 2023-07-12 13:13:57,141 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/0a031e8f783f4b15b7c8d629d62c180e as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/0a031e8f783f4b15b7c8d629d62c180e 2023-07-12 13:13:57,149 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/0a031e8f783f4b15b7c8d629d62c180e, entries=1, sequenceid=25, filesize=4.9 K 2023-07-12 13:13:57,150 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e60e2238d684b9eda52028c97b0e4a2e in 856ms, sequenceid=25, compaction requested=true 2023-07-12 13:13:57,151 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:13:57,151 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:57,151 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:57,151 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:57,151 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,151 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:13:57,151 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:13:57,153 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,153 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:57,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:57,153 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,153 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:57,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:57,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:57,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:57,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:13:57,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f5a3358[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:57,156 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:13:57,156 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,156 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,157 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:13:57,157 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:13:57,157 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:57,157 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,157 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:57,158 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,158 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:13:57,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:57,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:57,158 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:57,158 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:13:57,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:57,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:57,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:57,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:57,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:13:57,161 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:13:57,161 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:57,161 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:57,161 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,161 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:57,163 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,163 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:57,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,163 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:57,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:57,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:57,163 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:57,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:57,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:57,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,165 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:57,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,166 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,166 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,166 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:57,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:57,167 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:57,167 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,167 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:57,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:57,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:57,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:57,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-12 13:13:57,167 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,168 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,168 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,168 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,168 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:57,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:57,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:57,168 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:57,268 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:57,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:57,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:57,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:57,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,278 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:57,278 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:57,279 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:13:57,279 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:13:57,279 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,279 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,280 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,280 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:57,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:57,281 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:57,281 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,282 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,282 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:13:57,282 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:57,282 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:13:57,282 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:57,282 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:13:57,283 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:57,283 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:57,283 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:57,283 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. started... 2023-07-12 13:13:57,283 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e60e2238d684b9eda52028c97b0e4a2e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:57,711 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601014b2eb2f1968a4d2b8428a9f27adadf52 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601014b2eb2f1968a4d2b8428a9f27adadf52 2023-07-12 13:13:58,120 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/2c2d596726a04c23a10b9703035265a3 2023-07-12 13:13:58,128 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/2c2d596726a04c23a10b9703035265a3 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/2c2d596726a04c23a10b9703035265a3 2023-07-12 13:13:58,134 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/2c2d596726a04c23a10b9703035265a3, entries=1, sequenceid=29, filesize=4.9 K 2023-07-12 13:13:58,135 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e60e2238d684b9eda52028c97b0e4a2e in 852ms, sequenceid=29, compaction requested=true 2023-07-12 13:13:58,136 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:13:58,136 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:58,136 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:58,136 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:58,136 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,136 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:13:58,136 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:13:58,137 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,137 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:58,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:58,138 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,138 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:58,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:58,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:58,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:58,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:13:58,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b43fad9[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:58,139 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:13:58,139 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,140 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,140 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:13:58,140 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:13:58,140 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,140 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:58,140 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:58,141 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:13:58,141 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,141 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:58,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:58,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:58,141 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:13:58,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:58,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:58,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:58,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:58,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:13:58,146 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:13:58,146 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:58,146 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:58,146 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,146 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:58,148 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,148 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:58,148 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:58,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:58,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:58,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:58,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:58,149 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:58,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,150 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:58,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,152 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,152 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:58,152 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:58,152 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,152 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:58,152 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:58,152 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:58,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:58,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:58,153 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,153 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,153 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:58,153 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:58,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:58,153 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:58,253 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:58,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:58,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:58,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:58,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,263 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:58,263 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:58,264 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:13:58,264 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:13:58,265 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,265 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,266 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:58,266 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:58,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:58,266 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,266 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:58,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,267 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,267 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:13:58,267 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,267 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:13:58,267 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:58,268 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:13:58,268 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:58,268 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:58,268 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:58,268 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. started... 2023-07-12 13:13:58,268 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e60e2238d684b9eda52028c97b0e4a2e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:58,283 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103de866b249ff2449e937d1672927d2231 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103de866b249ff2449e937d1672927d2231 2023-07-12 13:13:58,288 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/b32f6cc28ea24ddfa7161c74fbd53e80 2023-07-12 13:13:58,294 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/b32f6cc28ea24ddfa7161c74fbd53e80 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/b32f6cc28ea24ddfa7161c74fbd53e80 2023-07-12 13:13:58,300 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/b32f6cc28ea24ddfa7161c74fbd53e80, entries=1, sequenceid=33, filesize=4.9 K 2023-07-12 13:13:58,301 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e60e2238d684b9eda52028c97b0e4a2e in 33ms, sequenceid=33, compaction requested=true 2023-07-12 13:13:58,301 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:13:58,301 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:58,301 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:58,301 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:58,302 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,302 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:13:58,302 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:13:58,303 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,303 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:58,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:58,303 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,303 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:58,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:58,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:58,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:58,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:13:58,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b8a8e91[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:58,305 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:13:58,305 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,306 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,307 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:13:58,307 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:13:58,307 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:58,307 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,307 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:58,308 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:13:58,308 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:58,308 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:13:58,310 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:58,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:58,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:58,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:13:58,317 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:13:58,317 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:58,317 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:58,317 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,317 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:58,319 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,319 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,319 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:58,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:58,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:58,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:58,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:58,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:58,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,320 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:58,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:58,321 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,323 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:58,323 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:58,323 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,323 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,323 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:58,324 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:58,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:58,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:58,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:58,324 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,325 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,325 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,325 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,325 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:58,325 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:58,425 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:58,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:58,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:58,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:58,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,442 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:58,442 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:58,443 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:13:58,443 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:13:58,443 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,443 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,444 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:58,444 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:58,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:58,445 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:58,445 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:58,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:58,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,445 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,446 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:13:58,446 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:58,446 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:13:58,446 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:58,446 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:13:58,446 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:58,446 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:58,447 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:58,447 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. started... 2023-07-12 13:13:58,447 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e60e2238d684b9eda52028c97b0e4a2e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:58,867 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a41990cbbe1249cd98120672509a87e8 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907a41990cbbe1249cd98120672509a87e8 2023-07-12 13:13:59,275 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/39af7aff35be402d8940aa63aac45db1 2023-07-12 13:13:59,281 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/39af7aff35be402d8940aa63aac45db1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/39af7aff35be402d8940aa63aac45db1 2023-07-12 13:13:59,287 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/39af7aff35be402d8940aa63aac45db1, entries=1, sequenceid=37, filesize=4.9 K 2023-07-12 13:13:59,288 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e60e2238d684b9eda52028c97b0e4a2e in 841ms, sequenceid=37, compaction requested=true 2023-07-12 13:13:59,288 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:13:59,288 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:59,288 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:13:59,288 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:13:59,288 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,288 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:13:59,288 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:13:59,290 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,290 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:59,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:59,290 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,290 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:13:59,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:59,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:59,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:59,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:13:59,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53c79567[Count = 0] remaining members to acquire global barrier 2023-07-12 13:13:59,292 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:13:59,292 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,293 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,293 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:13:59,293 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:13:59,293 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:13:59,293 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,293 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:13:59,294 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,294 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:13:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:59,294 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:59,294 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:13:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:13:59,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:13:59,298 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:13:59,298 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:13:59,298 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:13:59,298 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,298 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:13:59,300 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,300 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:13:59,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:13:59,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,300 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:59,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:13:59,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:59,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:59,301 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:13:59,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,302 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:13:59,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,305 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,305 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:59,305 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:59,305 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:13:59,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:59,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-12 13:13:59,305 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:59,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:13:59,305 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:13:59,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:13:59,305 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:13:59,306 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,306 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,306 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:13:59,306 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:13:59,306 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,407 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:13:59,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:13:59,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:13:59,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:13:59,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,415 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:13:59,415 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:59,416 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:13:59,416 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:13:59,416 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,416 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,417 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:13:59,417 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:13:59,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:13:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,418 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:13:59,418 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:13:59,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:13:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,418 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,419 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:13:59,419 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:13:59,419 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:13:59,419 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:13:59,420 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:13:59,421 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:13:59,421 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:13:59,421 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:13:59,421 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. started... 2023-07-12 13:13:59,421 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e60e2238d684b9eda52028c97b0e4a2e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:13:59,840 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120fc5150f6fc29478ab1331dc10bcb1bbb to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120fc5150f6fc29478ab1331dc10bcb1bbb 2023-07-12 13:14:00,248 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/ada2c17f1081421baf02bdf3484b775b 2023-07-12 13:14:00,256 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/ada2c17f1081421baf02bdf3484b775b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/ada2c17f1081421baf02bdf3484b775b 2023-07-12 13:14:00,265 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/ada2c17f1081421baf02bdf3484b775b, entries=1, sequenceid=41, filesize=4.9 K 2023-07-12 13:14:00,266 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e60e2238d684b9eda52028c97b0e4a2e in 845ms, sequenceid=41, compaction requested=true 2023-07-12 13:14:00,266 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:14:00,266 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:14:00,266 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:00,267 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:00,267 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,267 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:14:00,267 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:14:00,268 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,268 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:00,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:00,268 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,268 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:00,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:00,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:14:00,270 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:00,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2df9bcb4[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:00,270 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,270 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,270 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:00,270 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:14:00,270 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,271 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:00,270 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:00,271 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,271 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:14:00,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:00,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:00,271 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:00,272 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:14:00,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:00,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:00,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:00,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:00,274 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:14:00,274 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:00,274 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:00,275 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,275 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:00,276 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,276 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:00,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:00,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,276 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:00,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,276 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:00,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:00,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:00,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:00,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,277 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:00,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,279 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,279 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:00,279 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:00,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-12 13:14:00,279 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:00,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:00,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-12 13:14:00,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:00,279 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:00,279 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,279 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:00,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:00,281 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:00,281 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:00,281 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:00,281 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,281 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,381 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:00,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:00,384 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-07-12 13:14:00,386 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-12 13:14:00,386 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-12 13:14:00,387 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:00,387 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168240387 2023-07-12 13:14:00,389 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-12 13:14:00,390 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-07-12 13:14:00,390 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:14:00,391 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x33bce78c to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:14:00,395 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@426689a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:14:00,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:14:01,234 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039e0595abbaa3406182e4ecfd477cadae to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601039e0595abbaa3406182e4ecfd477cadae 2023-07-12 13:14:01,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:14:01,250 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:14:01,251 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:14:01,270 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:14:01,271 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:33504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:14:01,304 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/488226ff64b64e4991a0776e74c8c17b first=Optional[r5] last=Optional[r6] 2023-07-12 13:14:01,305 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/488226ff64b64e4991a0776e74c8c17b}] 2023-07-12 13:14:01,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/488226ff64b64e4991a0776e74c8c17b for inclusion in e60e2238d684b9eda52028c97b0e4a2e/family1 2023-07-12 13:14:01,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-07-12 13:14:01,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:14:01,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:14:01,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/488226ff64b64e4991a0776e74c8c17b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__po4ehk6htbcg6rck7egg54h29kse4431ne89me470bom63l2vh6glfcbo4l9mem9/family1/488226ff64b64e4991a0776e74c8c17b 2023-07-12 13:14:01,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__po4ehk6htbcg6rck7egg54h29kse4431ne89me470bom63l2vh6glfcbo4l9mem9/family1/488226ff64b64e4991a0776e74c8c17b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/49bb1ab6059243c4b9ee6cb3d9f8c44a_SeqId_44_ 2023-07-12 13:14:01,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__po4ehk6htbcg6rck7egg54h29kse4431ne89me470bom63l2vh6glfcbo4l9mem9/family1/488226ff64b64e4991a0776e74c8c17b into e60e2238d684b9eda52028c97b0e4a2e/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/49bb1ab6059243c4b9ee6cb3d9f8c44a_SeqId_44_ - updating store file list. 2023-07-12 13:14:01,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/49bb1ab6059243c4b9ee6cb3d9f8c44a_SeqId_44_ into e60e2238d684b9eda52028c97b0e4a2e/family1 2023-07-12 13:14:01,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__po4ehk6htbcg6rck7egg54h29kse4431ne89me470bom63l2vh6glfcbo4l9mem9/family1/488226ff64b64e4991a0776e74c8c17b into e60e2238d684b9eda52028c97b0e4a2e/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/49bb1ab6059243c4b9ee6cb3d9f8c44a_SeqId_44_) 2023-07-12 13:14:01,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__po4ehk6htbcg6rck7egg54h29kse4431ne89me470bom63l2vh6glfcbo4l9mem9/family1/488226ff64b64e4991a0776e74c8c17b 2023-07-12 13:14:01,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-12 13:14:01,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-12 13:14:01,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(1912): e60e2238d684b9eda52028c97b0e4a2e/family1 is initiating minor compaction 2023-07-12 13:14:01,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6d453c7d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:01,328 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e60e2238d684b9eda52028c97b0e4a2e/family1 in testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:14:01,328 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/74fa0398057140cf959d66eb35c8b807, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/a3bee8b9c97e4d9db4cb4be659000ca2, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/6f0eaa45d73946f8b3fc4c0d3d747fba, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/24edb1653fd143dabcff188ce7bb38a6, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/0a031e8f783f4b15b7c8d629d62c180e, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/2c2d596726a04c23a10b9703035265a3, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/b32f6cc28ea24ddfa7161c74fbd53e80, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/39af7aff35be402d8940aa63aac45db1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/ada2c17f1081421baf02bdf3484b775b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/49bb1ab6059243c4b9ee6cb3d9f8c44a_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp, totalSize=49.7 K 2023-07-12 13:14:01,329 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 74fa0398057140cf959d66eb35c8b807, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-12 13:14:01,329 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting a3bee8b9c97e4d9db4cb4be659000ca2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-12 13:14:01,329 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 6f0eaa45d73946f8b3fc4c0d3d747fba, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-12 13:14:01,329 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 24edb1653fd143dabcff188ce7bb38a6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-12 13:14:01,329 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 0a031e8f783f4b15b7c8d629d62c180e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-12 13:14:01,329 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 2c2d596726a04c23a10b9703035265a3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-12 13:14:01,329 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting b32f6cc28ea24ddfa7161c74fbd53e80, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-12 13:14:01,329 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 39af7aff35be402d8940aa63aac45db1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-12 13:14:01,329 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting ada2c17f1081421baf02bdf3484b775b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-12 13:14:01,330 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 49bb1ab6059243c4b9ee6cb3d9f8c44a_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-12 13:14:01,330 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:14:01,331 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:01,333 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601014b2eb2f1968a4d2b8428a9f27adadf52 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601014b2eb2f1968a4d2b8428a9f27adadf52 2023-07-12 13:14:01,336 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103de866b249ff2449e937d1672927d2231 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103de866b249ff2449e937d1672927d2231 2023-07-12 13:14:01,336 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-07-12 13:14:01,336 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-07-12 13:14:01,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:14:01,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:14:01,373 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): e60e2238d684b9eda52028c97b0e4a2e#family1#compaction#22 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:14:02,196 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/5ad24178400848dcae28facf3bea7612 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/5ad24178400848dcae28facf3bea7612 2023-07-12 13:14:02,200 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e7fe1a5d39294de9b1b382e53b5b5967 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231e7fe1a5d39294de9b1b382e53b5b5967 2023-07-12 13:14:02,201 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:14:02,203 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e60e2238d684b9eda52028c97b0e4a2e/family1 of e60e2238d684b9eda52028c97b0e4a2e into 5ad24178400848dcae28facf3bea7612(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:14:02,203 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:14:02,204 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1689167641328; duration=0sec 2023-07-12 13:14:02,204 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:02,238 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/af29f92b91b2416a9d799e1e263c1d27 first=Optional[r1] last=Optional[r4] 2023-07-12 13:14:02,239 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/af29f92b91b2416a9d799e1e263c1d27}] 2023-07-12 13:14:02,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/af29f92b91b2416a9d799e1e263c1d27 for inclusion in e60e2238d684b9eda52028c97b0e4a2e/family1 2023-07-12 13:14:02,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-07-12 13:14:02,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:14:02,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:14:02,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/af29f92b91b2416a9d799e1e263c1d27 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hsb3qo5jhhf5mcbvvrmfrtlqcnij9t6cr49f10mgucmmtv1f7nhma4vg8sd7dh1q/family1/af29f92b91b2416a9d799e1e263c1d27 2023-07-12 13:14:02,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hsb3qo5jhhf5mcbvvrmfrtlqcnij9t6cr49f10mgucmmtv1f7nhma4vg8sd7dh1q/family1/af29f92b91b2416a9d799e1e263c1d27 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/12c6fd329a2248dabbd6bfcc6dceb7ab_SeqId_47_ 2023-07-12 13:14:02,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hsb3qo5jhhf5mcbvvrmfrtlqcnij9t6cr49f10mgucmmtv1f7nhma4vg8sd7dh1q/family1/af29f92b91b2416a9d799e1e263c1d27 into e60e2238d684b9eda52028c97b0e4a2e/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/12c6fd329a2248dabbd6bfcc6dceb7ab_SeqId_47_ - updating store file list. 2023-07-12 13:14:02,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/12c6fd329a2248dabbd6bfcc6dceb7ab_SeqId_47_ into e60e2238d684b9eda52028c97b0e4a2e/family1 2023-07-12 13:14:02,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hsb3qo5jhhf5mcbvvrmfrtlqcnij9t6cr49f10mgucmmtv1f7nhma4vg8sd7dh1q/family1/af29f92b91b2416a9d799e1e263c1d27 into e60e2238d684b9eda52028c97b0e4a2e/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/12c6fd329a2248dabbd6bfcc6dceb7ab_SeqId_47_) 2023-07-12 13:14:02,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hsb3qo5jhhf5mcbvvrmfrtlqcnij9t6cr49f10mgucmmtv1f7nhma4vg8sd7dh1q/family1/af29f92b91b2416a9d799e1e263c1d27 2023-07-12 13:14:02,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 13:14:02,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 13:14:02,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(1912): e60e2238d684b9eda52028c97b0e4a2e/family1 is initiating minor compaction (all files) 2023-07-12 13:14:02,259 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e60e2238d684b9eda52028c97b0e4a2e/family1 in testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:14:02,259 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/2fcb915f7c4a42ee940b2bcc6f070170, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/5ad24178400848dcae28facf3bea7612, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/12c6fd329a2248dabbd6bfcc6dceb7ab_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp, totalSize=178.1 K 2023-07-12 13:14:02,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@22f77997; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:02,260 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 2fcb915f7c4a42ee940b2bcc6f070170, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837060 2023-07-12 13:14:02,260 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 5ad24178400848dcae28facf3bea7612, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237060 2023-07-12 13:14:02,261 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 12c6fd329a2248dabbd6bfcc6dceb7ab_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965237060 2023-07-12 13:14:02,263 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:14:02,264 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:02,268 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ef565c4932b643b7a1920c67dd987bf6 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ef565c4932b643b7a1920c67dd987bf6 2023-07-12 13:14:02,270 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205fb950bcf9c34490789c750c8acf01168 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205fb950bcf9c34490789c750c8acf01168 2023-07-12 13:14:02,271 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228c1b0de722fe44454b36723849501b752 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228c1b0de722fe44454b36723849501b752 2023-07-12 13:14:02,272 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512311cbe98bd6adf432781e11a996e641635 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512311cbe98bd6adf432781e11a996e641635 2023-07-12 13:14:02,272 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-07-12 13:14:02,272 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-07-12 13:14:02,273 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:14:02,273 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:14:02,281 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): e60e2238d684b9eda52028c97b0e4a2e#family1#compaction#23 average throughput is 17.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:14:02,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/74fa0398057140cf959d66eb35c8b807, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/a3bee8b9c97e4d9db4cb4be659000ca2, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/6f0eaa45d73946f8b3fc4c0d3d747fba, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/24edb1653fd143dabcff188ce7bb38a6, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/0a031e8f783f4b15b7c8d629d62c180e, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/2c2d596726a04c23a10b9703035265a3, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/b32f6cc28ea24ddfa7161c74fbd53e80, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/39af7aff35be402d8940aa63aac45db1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/ada2c17f1081421baf02bdf3484b775b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/49bb1ab6059243c4b9ee6cb3d9f8c44a_SeqId_44_] to archive 2023-07-12 13:14:02,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:02,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/74fa0398057140cf959d66eb35c8b807 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/74fa0398057140cf959d66eb35c8b807 2023-07-12 13:14:02,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/a3bee8b9c97e4d9db4cb4be659000ca2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/a3bee8b9c97e4d9db4cb4be659000ca2 2023-07-12 13:14:02,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/6f0eaa45d73946f8b3fc4c0d3d747fba to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/6f0eaa45d73946f8b3fc4c0d3d747fba 2023-07-12 13:14:02,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/24edb1653fd143dabcff188ce7bb38a6 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/24edb1653fd143dabcff188ce7bb38a6 2023-07-12 13:14:02,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/0a031e8f783f4b15b7c8d629d62c180e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/0a031e8f783f4b15b7c8d629d62c180e 2023-07-12 13:14:02,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/2c2d596726a04c23a10b9703035265a3 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/2c2d596726a04c23a10b9703035265a3 2023-07-12 13:14:02,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/b32f6cc28ea24ddfa7161c74fbd53e80 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/b32f6cc28ea24ddfa7161c74fbd53e80 2023-07-12 13:14:02,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/39af7aff35be402d8940aa63aac45db1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/39af7aff35be402d8940aa63aac45db1 2023-07-12 13:14:02,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/ada2c17f1081421baf02bdf3484b775b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/ada2c17f1081421baf02bdf3484b775b 2023-07-12 13:14:02,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/49bb1ab6059243c4b9ee6cb3d9f8c44a_SeqId_44_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/49bb1ab6059243c4b9ee6cb3d9f8c44a_SeqId_44_ 2023-07-12 13:14:02,753 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113043f7523ac31d4fb5b7eed98823cbc5fc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113043f7523ac31d4fb5b7eed98823cbc5fc 2023-07-12 13:14:02,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:14:02,784 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/830e98dd251d4d4abe6a96ed4062cfea first=Optional[r00] last=Optional[r8] 2023-07-12 13:14:02,785 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/830e98dd251d4d4abe6a96ed4062cfea}] 2023-07-12 13:14:02,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/830e98dd251d4d4abe6a96ed4062cfea for inclusion in e60e2238d684b9eda52028c97b0e4a2e/family1 2023-07-12 13:14:02,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-07-12 13:14:02,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:14:02,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:14:02,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/830e98dd251d4d4abe6a96ed4062cfea to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__i4cva9gtsdsp81iagullsa256cu7hd0bjn7ij1dt44929iofn3r3kipst9648cdq/family1/830e98dd251d4d4abe6a96ed4062cfea 2023-07-12 13:14:02,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__i4cva9gtsdsp81iagullsa256cu7hd0bjn7ij1dt44929iofn3r3kipst9648cdq/family1/830e98dd251d4d4abe6a96ed4062cfea as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/d3c70661aba044ac84d2a1458e1fb3ce_SeqId_49_ 2023-07-12 13:14:02,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__i4cva9gtsdsp81iagullsa256cu7hd0bjn7ij1dt44929iofn3r3kipst9648cdq/family1/830e98dd251d4d4abe6a96ed4062cfea into e60e2238d684b9eda52028c97b0e4a2e/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/d3c70661aba044ac84d2a1458e1fb3ce_SeqId_49_ - updating store file list. 2023-07-12 13:14:02,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/d3c70661aba044ac84d2a1458e1fb3ce_SeqId_49_ into e60e2238d684b9eda52028c97b0e4a2e/family1 2023-07-12 13:14:02,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__i4cva9gtsdsp81iagullsa256cu7hd0bjn7ij1dt44929iofn3r3kipst9648cdq/family1/830e98dd251d4d4abe6a96ed4062cfea into e60e2238d684b9eda52028c97b0e4a2e/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/d3c70661aba044ac84d2a1458e1fb3ce_SeqId_49_) 2023-07-12 13:14:02,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithMonthlyPolicy__i4cva9gtsdsp81iagullsa256cu7hd0bjn7ij1dt44929iofn3r3kipst9648cdq/family1/830e98dd251d4d4abe6a96ed4062cfea 2023-07-12 13:14:02,809 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:14:02,810 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:02,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120fc5150f6fc29478ab1331dc10bcb1bbb to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120fc5150f6fc29478ab1331dc10bcb1bbb 2023-07-12 13:14:02,814 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511280907d26884354fd69567fb257a0febcc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511280907d26884354fd69567fb257a0febcc 2023-07-12 13:14:02,815 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ba2e05ccf525423f9ecc5d25da5594a9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ba2e05ccf525423f9ecc5d25da5594a9 2023-07-12 13:14:02,815 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-07-12 13:14:02,815 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-12 13:14:02,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:14:02,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:14:02,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:14:02,816 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:14:02,816 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:02,817 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-12 13:14:02,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.4320 sec 2023-07-12 13:14:02,943 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=257 (was 252) Potentially hanging thread: hconnection-0x3e1a8e4a-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:38102 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e1a8e4a-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:38112 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:38124 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:38230 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:38096 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e1a8e4a-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e1a8e4a-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:38004 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:38062 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e1a8e4a-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:38134 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:38056 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e1a8e4a-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:38114 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:38048 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/81d84759224d4ace99bbc2e8de8a0ee1 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:38160 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51470@0x33bce78c-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1136397898_17 at /127.0.0.1:38104 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51470@0x33bce78c sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/140944349.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/cluster_2e6eebf2-882c-9df6-f703-f5434d9a427a/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:38120 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1136397898_17 at /127.0.0.1:38032 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189666531_17 at /127.0.0.1:38176 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51470@0x33bce78c-SendThread(127.0.0.1:51470) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x3e1a8e4a-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=611 (was 597) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=223 (was 250), ProcessCount=168 (was 168), AvailableMemoryMB=7798 (was 8025) 2023-07-12 13:14:02,955 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=257, OpenFileDescriptor=611, MaxFileDescriptor=60000, SystemLoadAverage=223, ProcessCount=168, AvailableMemoryMB=7796 2023-07-12 13:14:02,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-12 13:14:02,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:02,961 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:14:02,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-07-12 13:14:02,962 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:14:02,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-12 13:14:02,964 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095 2023-07-12 13:14:02,965 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095 empty. 2023-07-12 13:14:02,965 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095 2023-07-12 13:14:02,965 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-07-12 13:14:02,974 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-07-12 13:14:02,975 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8dbdd1e58659f82914d0046114f39095, NAME => 'testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:14:03,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-12 13:14:03,121 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/.tmp/family1/81d84759224d4ace99bbc2e8de8a0ee1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/81d84759224d4ace99bbc2e8de8a0ee1 2023-07-12 13:14:03,127 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e60e2238d684b9eda52028c97b0e4a2e/family1 of e60e2238d684b9eda52028c97b0e4a2e into 81d84759224d4ace99bbc2e8de8a0ee1(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:14:03,127 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:14:03,127 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1689167642259; duration=0sec 2023-07-12 13:14:03,127 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:03,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/2fcb915f7c4a42ee940b2bcc6f070170, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/5ad24178400848dcae28facf3bea7612, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/12c6fd329a2248dabbd6bfcc6dceb7ab_SeqId_47_] to archive 2023-07-12 13:14:03,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:03,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/2fcb915f7c4a42ee940b2bcc6f070170 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/2fcb915f7c4a42ee940b2bcc6f070170 2023-07-12 13:14:03,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/5ad24178400848dcae28facf3bea7612 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/5ad24178400848dcae28facf3bea7612 2023-07-12 13:14:03,187 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/12c6fd329a2248dabbd6bfcc6dceb7ab_SeqId_47_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/family1/12c6fd329a2248dabbd6bfcc6dceb7ab_SeqId_47_ 2023-07-12 13:14:03,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-12 13:14:03,383 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:03,383 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 8dbdd1e58659f82914d0046114f39095, disabling compactions & flushes 2023-07-12 13:14:03,383 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:03,383 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:03,383 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. after waiting 0 ms 2023-07-12 13:14:03,383 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:03,383 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:03,383 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:03,386 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:14:03,387 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689167643387"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167643387"}]},"ts":"1689167643387"} 2023-07-12 13:14:03,388 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 13:14:03,390 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:14:03,390 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167643390"}]},"ts":"1689167643390"} 2023-07-12 13:14:03,391 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-07-12 13:14:03,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8dbdd1e58659f82914d0046114f39095, ASSIGN}] 2023-07-12 13:14:03,397 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8dbdd1e58659f82914d0046114f39095, ASSIGN 2023-07-12 13:14:03,398 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8dbdd1e58659f82914d0046114f39095, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:14:03,549 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=8dbdd1e58659f82914d0046114f39095, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:03,549 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689167643549"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167643549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167643549"}]},"ts":"1689167643549"} 2023-07-12 13:14:03,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 8dbdd1e58659f82914d0046114f39095, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:14:03,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-12 13:14:03,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:03,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8dbdd1e58659f82914d0046114f39095, NAME => 'testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:14:03,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 8dbdd1e58659f82914d0046114f39095 2023-07-12 13:14:03,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:03,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 8dbdd1e58659f82914d0046114f39095 2023-07-12 13:14:03,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 8dbdd1e58659f82914d0046114f39095 2023-07-12 13:14:03,710 INFO [StoreOpener-8dbdd1e58659f82914d0046114f39095-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8dbdd1e58659f82914d0046114f39095 2023-07-12 13:14:03,711 DEBUG [StoreOpener-8dbdd1e58659f82914d0046114f39095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1 2023-07-12 13:14:03,711 DEBUG [StoreOpener-8dbdd1e58659f82914d0046114f39095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1 2023-07-12 13:14:03,712 INFO [StoreOpener-8dbdd1e58659f82914d0046114f39095-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8dbdd1e58659f82914d0046114f39095 columnFamilyName family1 2023-07-12 13:14:03,713 INFO [StoreOpener-8dbdd1e58659f82914d0046114f39095-1] regionserver.HStore(310): Store=8dbdd1e58659f82914d0046114f39095/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:14:03,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095 2023-07-12 13:14:03,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095 2023-07-12 13:14:03,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 8dbdd1e58659f82914d0046114f39095 2023-07-12 13:14:03,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:14:03,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 8dbdd1e58659f82914d0046114f39095; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67261756, jitterRate=0.002278268337249756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:14:03,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:03,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095., pid=25, masterSystemTime=1689167643704 2023-07-12 13:14:03,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:03,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:03,725 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=8dbdd1e58659f82914d0046114f39095, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:03,725 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689167643724"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167643724"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167643724"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167643724"}]},"ts":"1689167643724"} 2023-07-12 13:14:03,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-07-12 13:14:03,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 8dbdd1e58659f82914d0046114f39095, server=jenkins-hbase17.apache.org,41721,1689167613545 in 175 msec 2023-07-12 13:14:03,730 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-12 13:14:03,730 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8dbdd1e58659f82914d0046114f39095, ASSIGN in 333 msec 2023-07-12 13:14:03,731 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:14:03,731 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167643731"}]},"ts":"1689167643731"} 2023-07-12 13:14:03,732 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-07-12 13:14:03,734 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:14:03,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 776 msec 2023-07-12 13:14:04,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-12 13:14:04,070 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-07-12 13:14:04,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:04,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,102 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:04,102 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:04,102 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:04,102 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:04,103 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,103 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,103 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:04,103 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:04,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:04,104 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,104 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:04,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:04,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,105 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,105 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:04,105 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:04,105 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:04,105 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:04,105 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:04,105 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:04,105 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. started... 2023-07-12 13:14:04,106 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8dbdd1e58659f82914d0046114f39095 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-12 13:14:04,527 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113089a2e579f83942eaafa74421afd10ba7 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015113089a2e579f83942eaafa74421afd10ba7 2023-07-12 13:14:04,774 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:04,933 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/3bf78528932b48f0b8a9875b77456f65 2023-07-12 13:14:04,943 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/3bf78528932b48f0b8a9875b77456f65 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/3bf78528932b48f0b8a9875b77456f65 2023-07-12 13:14:04,948 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/3bf78528932b48f0b8a9875b77456f65, entries=1000, sequenceid=5, filesize=165.1 K 2023-07-12 13:14:04,950 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8dbdd1e58659f82914d0046114f39095 in 843ms, sequenceid=5, compaction requested=false 2023-07-12 13:14:04,950 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:04,950 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:04,950 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:04,951 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:04,951 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,951 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:04,951 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:04,952 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,952 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:04,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:04,953 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,953 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:04,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:04,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:04,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:04,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:04,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9c81ee0[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:04,955 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:04,955 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,956 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,956 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:04,956 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:04,957 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:04,957 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,957 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:04,958 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,958 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:04,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:04,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:04,958 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:04,958 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:04,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:04,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:04,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:04,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:04,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:04,961 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:04,961 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:04,961 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:04,961 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,961 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:04,962 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,962 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:04,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:04,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,962 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:04,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:04,963 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:04,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:04,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:04,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,965 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:04,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,967 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,967 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,967 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:04,967 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:04,968 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:04,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:04,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:04,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:04,968 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:04,968 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:04,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:04,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:04,968 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,968 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:04,969 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:04,969 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:04,969 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,069 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:05,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:05,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:05,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:05,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,081 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:05,081 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:05,081 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:05,081 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:05,082 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,082 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,083 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:05,083 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:05,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:05,083 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,083 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:05,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:05,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,084 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,084 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:05,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,084 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:05,084 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:05,084 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:05,084 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:05,085 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:05,085 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:05,085 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. started... 2023-07-12 13:14:05,085 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8dbdd1e58659f82914d0046114f39095 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-12 13:14:05,500 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128cdf42539674a40159c8695871dda6c62 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128cdf42539674a40159c8695871dda6c62 2023-07-12 13:14:05,906 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/f75fd1c5f27944a0811bed907c4ea78a 2023-07-12 13:14:05,912 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/f75fd1c5f27944a0811bed907c4ea78a as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/f75fd1c5f27944a0811bed907c4ea78a 2023-07-12 13:14:05,917 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/f75fd1c5f27944a0811bed907c4ea78a, entries=1, sequenceid=9, filesize=5.0 K 2023-07-12 13:14:05,918 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8dbdd1e58659f82914d0046114f39095 in 833ms, sequenceid=9, compaction requested=false 2023-07-12 13:14:05,918 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:05,918 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:05,918 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:05,918 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:05,918 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,918 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:05,918 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:05,919 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,919 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:05,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:05,919 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,919 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:05,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:05,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:05,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:05,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:05,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76c9f74e[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:05,921 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:05,921 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,921 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,921 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:05,921 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:05,921 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,921 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:05,921 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:05,922 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,922 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:05,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:05,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:05,922 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:05,923 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:05,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:05,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:05,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:05,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:05,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:05,924 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:05,924 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:05,924 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:05,924 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,924 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:05,925 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,925 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:05,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:05,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,925 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:05,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:05,926 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:05,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:05,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:05,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,926 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:05,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,928 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:05,928 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:05,928 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:05,928 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:05,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:05,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:05,928 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:05,928 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,928 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:05,928 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,928 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,928 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:05,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:05,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:05,928 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:05,928 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:06,029 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:06,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:06,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:06,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:06,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,040 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:06,040 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:06,040 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:06,040 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:06,041 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,041 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,042 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:06,042 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:06,042 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,042 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,043 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,048 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:06,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,048 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:06,048 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:06,048 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:06,054 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:06,054 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:06,054 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:06,054 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. started... 2023-07-12 13:14:06,055 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8dbdd1e58659f82914d0046114f39095 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:06,069 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201328474f17ae4432c84aa1622c5896db9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201328474f17ae4432c84aa1622c5896db9 2023-07-12 13:14:06,476 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/c92b35b8c2d8498cbe4e7b53e06fb1a9 2023-07-12 13:14:06,486 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/c92b35b8c2d8498cbe4e7b53e06fb1a9 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/c92b35b8c2d8498cbe4e7b53e06fb1a9 2023-07-12 13:14:06,493 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/c92b35b8c2d8498cbe4e7b53e06fb1a9, entries=1, sequenceid=13, filesize=4.9 K 2023-07-12 13:14:06,495 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dbdd1e58659f82914d0046114f39095 in 440ms, sequenceid=13, compaction requested=true 2023-07-12 13:14:06,495 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:06,495 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:06,495 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:06,495 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:06,495 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,495 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:06,495 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:06,496 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,496 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:06,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:06,497 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,497 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:06,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:06,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:06,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:06,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:06,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@194a385d[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:06,498 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:06,498 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,499 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,499 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:06,499 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:06,499 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:06,499 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,500 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:06,500 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,500 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:06,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:06,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:06,500 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:06,501 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:06,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:06,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:06,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:06,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:06,503 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:06,503 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:06,503 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:06,503 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,503 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:06,504 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,504 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:06,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,504 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:06,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:06,505 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:06,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:06,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:06,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:06,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,506 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:06,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,509 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,509 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:06,509 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,509 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:06,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:06,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:06,509 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,510 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,510 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-12 13:14:06,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:06,509 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:06,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:06,510 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:06,510 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,510 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:06,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:06,510 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:06,610 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:06,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:06,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:06,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:06,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,627 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:06,627 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:06,627 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:06,628 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:06,628 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,629 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,630 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:06,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:06,630 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,631 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:06,631 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:06,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:06,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,633 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,633 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:06,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:06,634 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:06,634 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:06,634 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:06,634 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:06,634 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:06,634 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:06,634 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. started... 2023-07-12 13:14:06,635 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8dbdd1e58659f82914d0046114f39095 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:07,054 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052fe8114134c54afab25d0bb6a5047f60 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052fe8114134c54afab25d0bb6a5047f60 2023-07-12 13:14:07,460 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/74726e7785f743809146c3e308ba9135 2023-07-12 13:14:07,473 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/74726e7785f743809146c3e308ba9135 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/74726e7785f743809146c3e308ba9135 2023-07-12 13:14:07,479 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/74726e7785f743809146c3e308ba9135, entries=1, sequenceid=17, filesize=4.9 K 2023-07-12 13:14:07,480 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dbdd1e58659f82914d0046114f39095 in 845ms, sequenceid=17, compaction requested=true 2023-07-12 13:14:07,481 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:07,481 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:07,481 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:07,481 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:07,481 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,481 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:07,481 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:07,482 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,482 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:07,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:07,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:07,482 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,483 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:07,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:07,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:07,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:07,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79b62bdc[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:07,484 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:07,484 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,484 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,485 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:07,485 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:07,485 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,485 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:07,485 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:07,486 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,486 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:07,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:07,486 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:07,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:07,486 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:07,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:07,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:07,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:07,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:07,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:07,488 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:07,488 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:07,488 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:07,488 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,488 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:07,489 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,489 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:07,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,489 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:07,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:07,490 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:07,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,491 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,492 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,492 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,492 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:07,492 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:07,493 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:07,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:07,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:07,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-12 13:14:07,493 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:07,493 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:07,493 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:07,493 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:07,493 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,493 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:07,494 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:07,594 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:07,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:07,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:07,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:07,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,602 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:07,602 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:07,602 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:07,602 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:07,603 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,603 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,604 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:07,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:07,605 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,605 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:07,606 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:07,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,607 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,607 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:07,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:07,608 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:07,608 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:07,608 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:07,608 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:07,608 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:07,608 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:07,608 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. started... 2023-07-12 13:14:07,608 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8dbdd1e58659f82914d0046114f39095 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:08,057 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:14:08,057 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122886b9ee34cbb1471a8a374669b69a4130 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122886b9ee34cbb1471a8a374669b69a4130 2023-07-12 13:14:08,057 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33bce78c to 127.0.0.1:51470 2023-07-12 13:14:08,057 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:14:08,068 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:14:08,068 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x253ac120 to 127.0.0.1:51470 2023-07-12 13:14:08,069 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:14:08,072 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:14:08,072 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76c9a269 to 127.0.0.1:51470 2023-07-12 13:14:08,072 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:14:08,480 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/57f5d00941b74812bd729ddfb46c4222 2023-07-12 13:14:08,494 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/57f5d00941b74812bd729ddfb46c4222 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/57f5d00941b74812bd729ddfb46c4222 2023-07-12 13:14:08,501 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/57f5d00941b74812bd729ddfb46c4222, entries=1, sequenceid=21, filesize=4.9 K 2023-07-12 13:14:08,502 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dbdd1e58659f82914d0046114f39095 in 894ms, sequenceid=21, compaction requested=true 2023-07-12 13:14:08,503 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:08,503 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:08,503 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:08,503 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:08,503 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,503 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:08,503 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:08,505 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,505 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:08,505 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,505 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:08,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:08,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30400514[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:08,508 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:08,508 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,509 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,509 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:08,509 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,510 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:08,509 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:08,510 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:08,511 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,511 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:08,511 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:08,511 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:08,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:08,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:08,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:08,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:08,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:08,515 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:08,515 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:08,515 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:08,515 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,515 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:08,517 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,517 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,517 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:08,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:08,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:08,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:08,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:08,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:08,518 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:08,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,520 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:08,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,523 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,523 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,523 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,523 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,523 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:08,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:08,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:08,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-12 13:14:08,523 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:08,523 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:08,523 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:08,524 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,524 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:08,524 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,524 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:08,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:08,624 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:08,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:08,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:08,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:08,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,642 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:08,642 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:08,642 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:08,642 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:08,643 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,643 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,644 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:08,645 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:08,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:08,645 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:08,646 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:08,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:08,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,647 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,647 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:08,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:08,647 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:08,648 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:08,648 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:08,648 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:08,648 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:08,648 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:08,648 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. started... 2023-07-12 13:14:08,648 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8dbdd1e58659f82914d0046114f39095 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:09,074 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123122529bee374546339a72c5c23aca028e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123122529bee374546339a72c5c23aca028e 2023-07-12 13:14:09,237 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 13:14:09,481 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/26c0207955c4425b9483cd3cf7248a55 2023-07-12 13:14:09,487 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/26c0207955c4425b9483cd3cf7248a55 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/26c0207955c4425b9483cd3cf7248a55 2023-07-12 13:14:09,492 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/26c0207955c4425b9483cd3cf7248a55, entries=1, sequenceid=25, filesize=4.9 K 2023-07-12 13:14:09,493 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dbdd1e58659f82914d0046114f39095 in 845ms, sequenceid=25, compaction requested=true 2023-07-12 13:14:09,493 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:09,493 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:09,493 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:09,493 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:09,493 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,493 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:09,493 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:09,494 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,494 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:09,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:09,495 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,495 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:09,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:09,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:09,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:09,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:09,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@90ae7d5[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:09,496 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:09,496 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,497 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,497 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:09,497 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:09,497 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:09,497 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,497 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:09,499 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,499 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:09,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:09,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:09,499 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:09,499 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:09,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:09,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:09,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:09,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:09,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:09,501 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:09,501 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:09,501 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:09,501 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,501 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:09,502 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,502 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:09,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:09,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,502 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:09,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:09,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:09,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:09,503 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:09,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,504 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,506 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,506 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,506 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:09,507 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:09,507 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:09,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:09,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:09,507 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:09,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:09,507 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:09,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-12 13:14:09,507 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:09,507 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,507 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:09,508 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,508 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,608 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:09,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:09,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:09,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:09,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,615 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:09,616 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:09,616 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:09,616 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:09,616 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,617 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,617 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:09,617 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:09,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:09,618 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:09,618 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:09,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:09,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,618 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,619 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:09,619 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:09,619 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:09,619 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:09,619 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:09,619 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:09,619 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:09,619 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:09,619 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. started... 2023-07-12 13:14:09,619 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8dbdd1e58659f82914d0046114f39095 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:10,037 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101fcef2f9c35244c9f8109fd865882e728 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101fcef2f9c35244c9f8109fd865882e728 2023-07-12 13:14:10,443 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/3b1e53702fb6448e974ec6bcc923ef01 2023-07-12 13:14:10,448 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/3b1e53702fb6448e974ec6bcc923ef01 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/3b1e53702fb6448e974ec6bcc923ef01 2023-07-12 13:14:10,454 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/3b1e53702fb6448e974ec6bcc923ef01, entries=1, sequenceid=29, filesize=4.9 K 2023-07-12 13:14:10,455 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dbdd1e58659f82914d0046114f39095 in 836ms, sequenceid=29, compaction requested=true 2023-07-12 13:14:10,455 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:10,455 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:10,455 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:10,455 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:10,455 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,455 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:10,455 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:10,456 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,456 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:10,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:10,457 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,457 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:10,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:10,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@414aae79[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:10,458 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:10,458 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,459 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,459 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:10,459 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:10,459 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,459 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:10,459 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:10,460 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,460 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:10,460 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:10,460 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:10,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:10,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:10,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:10,462 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:10,462 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:10,462 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:10,462 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,463 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:10,464 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,464 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:10,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,464 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:10,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:10,464 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,465 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,467 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,467 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:10,467 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:10,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:10,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:10,467 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:10,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:10,467 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:10,467 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,467 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,467 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,467 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:10,467 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,467 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:10,467 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:10,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:10,567 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:10,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:10,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:10,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:10,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,575 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:10,575 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:10,575 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:10,575 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:10,575 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,575 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,576 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,576 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:10,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:10,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:10,576 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:10,577 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:10,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:10,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,577 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,578 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:10,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:10,578 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:10,578 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:10,578 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:10,578 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:10,578 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:10,578 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:10,578 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. started... 2023-07-12 13:14:10,578 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8dbdd1e58659f82914d0046114f39095 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:10,592 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010386548573030f4cc081b09216f1dd524b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010386548573030f4cc081b09216f1dd524b 2023-07-12 13:14:10,998 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/9f2de15708e542bfbee866a33bb16ff1 2023-07-12 13:14:11,005 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/9f2de15708e542bfbee866a33bb16ff1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/9f2de15708e542bfbee866a33bb16ff1 2023-07-12 13:14:11,011 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/9f2de15708e542bfbee866a33bb16ff1, entries=1, sequenceid=33, filesize=4.9 K 2023-07-12 13:14:11,012 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dbdd1e58659f82914d0046114f39095 in 434ms, sequenceid=33, compaction requested=true 2023-07-12 13:14:11,012 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:11,012 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:11,012 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:11,012 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:11,012 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,012 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:11,012 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:11,013 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,013 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:11,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:11,014 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,014 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:11,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:11,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:11,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:11,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:11,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@96a8547[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:11,015 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:11,015 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,016 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,016 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:11,016 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:11,016 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,016 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:11,016 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:11,017 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:11,017 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,017 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:11,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:11,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:11,017 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:11,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:11,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:11,019 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:11,019 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:11,019 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:11,019 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,019 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:11,023 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,023 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,023 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:11,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:11,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:11,024 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:11,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:11,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:11,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:11,024 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:11,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,026 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,026 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,026 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:11,026 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:11,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:11,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:11,026 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:11,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:11,026 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:11,026 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-12 13:14:11,026 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,026 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:11,026 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,026 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:11,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:11,026 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:11,127 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:11,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:11,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:11,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:11,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,134 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:11,134 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:11,134 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:11,134 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:11,135 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,135 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,136 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:11,136 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:11,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:11,136 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,136 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:11,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:11,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,137 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,137 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:11,137 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,137 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:11,137 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:11,137 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:11,137 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:11,137 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:11,137 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:11,137 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. started... 2023-07-12 13:14:11,137 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8dbdd1e58659f82914d0046114f39095 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:11,552 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509071288707070bc43428a1b6f58355211de to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509071288707070bc43428a1b6f58355211de 2023-07-12 13:14:11,958 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/604213558e624cdd9e4c149df6309cd5 2023-07-12 13:14:11,965 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/604213558e624cdd9e4c149df6309cd5 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/604213558e624cdd9e4c149df6309cd5 2023-07-12 13:14:11,970 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/604213558e624cdd9e4c149df6309cd5, entries=1, sequenceid=37, filesize=4.9 K 2023-07-12 13:14:11,971 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dbdd1e58659f82914d0046114f39095 in 834ms, sequenceid=37, compaction requested=true 2023-07-12 13:14:11,971 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:11,971 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:11,971 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:11,971 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:11,971 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,972 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:11,972 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:11,973 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,973 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:11,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:11,974 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,974 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:11,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:11,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:11,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:11,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:11,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39b259db[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:11,975 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:11,975 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,976 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,976 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:11,976 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:11,976 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,976 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:11,976 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:11,977 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,977 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:11,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:11,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:11,977 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:11,977 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:11,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:11,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:11,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:11,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:11,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:11,980 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:11,980 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:11,980 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:11,980 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,980 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:11,981 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,981 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:11,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:11,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,981 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:11,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,982 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:11,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:11,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:11,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:11,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,983 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:11,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,984 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,984 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,984 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,984 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:11,984 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:11,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:11,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-12 13:14:11,984 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:11,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:11,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:11,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:11,984 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:11,985 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,985 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,985 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:11,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:11,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:11,985 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:11,985 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:12,085 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:12,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:12,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:12,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:12,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,093 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:12,093 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:12,093 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:12,093 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:12,093 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,093 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,094 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:12,094 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:12,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:12,094 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,094 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:12,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:12,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,095 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,095 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:12,095 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,095 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:12,095 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:12,096 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:12,096 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:12,096 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:12,096 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:12,096 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. started... 2023-07-12 13:14:12,096 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8dbdd1e58659f82914d0046114f39095 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:12,510 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511206d0705e58fa741ef99e6558e172fc52d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511206d0705e58fa741ef99e6558e172fc52d 2023-07-12 13:14:12,919 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/013655cc24ec4423813224b2ee0f3eb0 2023-07-12 13:14:12,925 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/013655cc24ec4423813224b2ee0f3eb0 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/013655cc24ec4423813224b2ee0f3eb0 2023-07-12 13:14:12,932 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/013655cc24ec4423813224b2ee0f3eb0, entries=1, sequenceid=41, filesize=4.9 K 2023-07-12 13:14:12,933 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dbdd1e58659f82914d0046114f39095 in 837ms, sequenceid=41, compaction requested=true 2023-07-12 13:14:12,933 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:12,933 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:12,933 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:12,933 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:12,933 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,933 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:12,933 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:12,934 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,934 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:12,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:12,935 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,935 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:12,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:12,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:12,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:12,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:12,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67582577[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:12,936 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:12,936 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,937 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,937 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:12,937 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:12,937 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:12,937 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,937 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:12,938 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:12,938 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:12,938 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,938 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:12,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:12,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:12,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:12,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:12,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:12,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:12,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:12,940 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:12,940 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:12,940 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:12,940 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,940 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:12,941 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,941 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,942 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:12,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:12,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:12,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:12,942 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:12,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:12,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:12,943 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:12,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,945 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,945 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,945 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:12,945 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:12,945 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:12,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:12,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-12 13:14:12,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:12,945 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:12,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:12,945 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:12,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:12,945 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:12,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-12 13:14:12,945 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,946 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:12,946 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:12,946 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:13,046 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:13,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:13,049 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-07-12 13:14:13,050 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-12 13:14:13,051 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-12 13:14:13,052 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:13,052 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168253052 2023-07-12 13:14:13,053 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-12 13:14:13,054 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-07-12 13:14:13,054 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-12 13:14:13,055 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x62035241 to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:14:13,061 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14dee421, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:14:13,061 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:13,534 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037469727c0eb14b0abe254459131408a9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601037469727c0eb14b0abe254459131408a9 2023-07-12 13:14:13,535 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-12 13:14:13,546 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:14:13,548 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:39186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:14:13,555 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:14:13,557 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:14:13,568 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1dfb22fbc98646498d3ca9da4d154f88 first=Optional[r3] last=Optional[r6] 2023-07-12 13:14:13,569 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1dfb22fbc98646498d3ca9da4d154f88}] 2023-07-12 13:14:13,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1dfb22fbc98646498d3ca9da4d154f88 for inclusion in 8dbdd1e58659f82914d0046114f39095/family1 2023-07-12 13:14:13,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-12 13:14:13,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:14:13,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:13,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1dfb22fbc98646498d3ca9da4d154f88 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4n7pcool0f4tvvl43um85ejd7ke2bgblbjmo144s1tja9biegtev2fmnmj13ph4t/family1/1dfb22fbc98646498d3ca9da4d154f88 2023-07-12 13:14:13,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4n7pcool0f4tvvl43um85ejd7ke2bgblbjmo144s1tja9biegtev2fmnmj13ph4t/family1/1dfb22fbc98646498d3ca9da4d154f88 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/23e5f6bf9dd3464db151ff34d0d70023_SeqId_44_ 2023-07-12 13:14:13,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4n7pcool0f4tvvl43um85ejd7ke2bgblbjmo144s1tja9biegtev2fmnmj13ph4t/family1/1dfb22fbc98646498d3ca9da4d154f88 into 8dbdd1e58659f82914d0046114f39095/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/23e5f6bf9dd3464db151ff34d0d70023_SeqId_44_ - updating store file list. 2023-07-12 13:14:13,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/23e5f6bf9dd3464db151ff34d0d70023_SeqId_44_ into 8dbdd1e58659f82914d0046114f39095/family1 2023-07-12 13:14:13,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4n7pcool0f4tvvl43um85ejd7ke2bgblbjmo144s1tja9biegtev2fmnmj13ph4t/family1/1dfb22fbc98646498d3ca9da4d154f88 into 8dbdd1e58659f82914d0046114f39095/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/23e5f6bf9dd3464db151ff34d0d70023_SeqId_44_) 2023-07-12 13:14:13,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4n7pcool0f4tvvl43um85ejd7ke2bgblbjmo144s1tja9biegtev2fmnmj13ph4t/family1/1dfb22fbc98646498d3ca9da4d154f88 2023-07-12 13:14:13,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-12 13:14:13,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-12 13:14:13,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(1912): 8dbdd1e58659f82914d0046114f39095/family1 is initiating minor compaction 2023-07-12 13:14:13,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7a71aa8a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:13,596 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8dbdd1e58659f82914d0046114f39095/family1 in testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:13,596 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/f75fd1c5f27944a0811bed907c4ea78a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/c92b35b8c2d8498cbe4e7b53e06fb1a9, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/74726e7785f743809146c3e308ba9135, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/57f5d00941b74812bd729ddfb46c4222, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/26c0207955c4425b9483cd3cf7248a55, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/3b1e53702fb6448e974ec6bcc923ef01, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/9f2de15708e542bfbee866a33bb16ff1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/604213558e624cdd9e4c149df6309cd5, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/013655cc24ec4423813224b2ee0f3eb0, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/23e5f6bf9dd3464db151ff34d0d70023_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp, totalSize=50.0 K 2023-07-12 13:14:13,596 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting f75fd1c5f27944a0811bed907c4ea78a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-12 13:14:13,596 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting c92b35b8c2d8498cbe4e7b53e06fb1a9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-12 13:14:13,596 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 74726e7785f743809146c3e308ba9135, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-12 13:14:13,596 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 57f5d00941b74812bd729ddfb46c4222, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-12 13:14:13,597 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 26c0207955c4425b9483cd3cf7248a55, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-12 13:14:13,597 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 3b1e53702fb6448e974ec6bcc923ef01, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-12 13:14:13,597 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 9f2de15708e542bfbee866a33bb16ff1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-12 13:14:13,597 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 604213558e624cdd9e4c149df6309cd5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-12 13:14:13,597 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 013655cc24ec4423813224b2ee0f3eb0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-12 13:14:13,597 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 23e5f6bf9dd3464db151ff34d0d70023_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-12 13:14:13,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-12 13:14:13,600 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:13,602 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122886b9ee34cbb1471a8a374669b69a4130 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122886b9ee34cbb1471a8a374669b69a4130 2023-07-12 13:14:13,605 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123122529bee374546339a72c5c23aca028e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123122529bee374546339a72c5c23aca028e 2023-07-12 13:14:13,606 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101fcef2f9c35244c9f8109fd865882e728 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101fcef2f9c35244c9f8109fd865882e728 2023-07-12 13:14:13,608 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010386548573030f4cc081b09216f1dd524b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010386548573030f4cc081b09216f1dd524b 2023-07-12 13:14:13,608 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-07-12 13:14:13,609 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-12 13:14:13,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:13,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:13,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:13,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:13,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:13,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:13,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:13,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:13,643 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8dbdd1e58659f82914d0046114f39095#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:14:14,448 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120556128fe8776e42bc91cec00a321f33b7 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120556128fe8776e42bc91cec00a321f33b7 2023-07-12 13:14:14,450 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-12 13:14:14,461 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/95a7d6ff3cf94da7801db13e708e140b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/95a7d6ff3cf94da7801db13e708e140b 2023-07-12 13:14:14,467 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8dbdd1e58659f82914d0046114f39095/family1 of 8dbdd1e58659f82914d0046114f39095 into 95a7d6ff3cf94da7801db13e708e140b(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:14:14,467 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:14,467 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1689167653596; duration=0sec 2023-07-12 13:14:14,467 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:14,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/f75fd1c5f27944a0811bed907c4ea78a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/c92b35b8c2d8498cbe4e7b53e06fb1a9, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/74726e7785f743809146c3e308ba9135, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/57f5d00941b74812bd729ddfb46c4222, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/26c0207955c4425b9483cd3cf7248a55, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/3b1e53702fb6448e974ec6bcc923ef01, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/9f2de15708e542bfbee866a33bb16ff1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/604213558e624cdd9e4c149df6309cd5, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/013655cc24ec4423813224b2ee0f3eb0, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/23e5f6bf9dd3464db151ff34d0d70023_SeqId_44_] to archive 2023-07-12 13:14:14,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:14,490 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/03c655dc6dce484695dd1e000bdc031b first=Optional[r1] last=Optional[r2] 2023-07-12 13:14:14,490 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/03c655dc6dce484695dd1e000bdc031b}] 2023-07-12 13:14:14,492 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/f75fd1c5f27944a0811bed907c4ea78a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/f75fd1c5f27944a0811bed907c4ea78a 2023-07-12 13:14:14,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/03c655dc6dce484695dd1e000bdc031b for inclusion in 8dbdd1e58659f82914d0046114f39095/family1 2023-07-12 13:14:14,494 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/c92b35b8c2d8498cbe4e7b53e06fb1a9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/c92b35b8c2d8498cbe4e7b53e06fb1a9 2023-07-12 13:14:14,495 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/74726e7785f743809146c3e308ba9135 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/74726e7785f743809146c3e308ba9135 2023-07-12 13:14:14,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-07-12 13:14:14,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/57f5d00941b74812bd729ddfb46c4222 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/57f5d00941b74812bd729ddfb46c4222 2023-07-12 13:14:14,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:14:14,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:14,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/03c655dc6dce484695dd1e000bdc031b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithWeeklyPolicy__smhuba2d393v2a7a176nh3rmt7pmgspmg6umac1ipijl8s8g0fkmbhscnmcuqmvm/family1/03c655dc6dce484695dd1e000bdc031b 2023-07-12 13:14:14,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/26c0207955c4425b9483cd3cf7248a55 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/26c0207955c4425b9483cd3cf7248a55 2023-07-12 13:14:14,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/3b1e53702fb6448e974ec6bcc923ef01 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/3b1e53702fb6448e974ec6bcc923ef01 2023-07-12 13:14:14,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithWeeklyPolicy__smhuba2d393v2a7a176nh3rmt7pmgspmg6umac1ipijl8s8g0fkmbhscnmcuqmvm/family1/03c655dc6dce484695dd1e000bdc031b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/4f379a733bc74d3fbfbd4ea298dae334_SeqId_47_ 2023-07-12 13:14:14,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/9f2de15708e542bfbee866a33bb16ff1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/9f2de15708e542bfbee866a33bb16ff1 2023-07-12 13:14:14,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithWeeklyPolicy__smhuba2d393v2a7a176nh3rmt7pmgspmg6umac1ipijl8s8g0fkmbhscnmcuqmvm/family1/03c655dc6dce484695dd1e000bdc031b into 8dbdd1e58659f82914d0046114f39095/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/4f379a733bc74d3fbfbd4ea298dae334_SeqId_47_ - updating store file list. 2023-07-12 13:14:14,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/604213558e624cdd9e4c149df6309cd5 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/604213558e624cdd9e4c149df6309cd5 2023-07-12 13:14:14,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/013655cc24ec4423813224b2ee0f3eb0 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/013655cc24ec4423813224b2ee0f3eb0 2023-07-12 13:14:14,512 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/23e5f6bf9dd3464db151ff34d0d70023_SeqId_44_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/23e5f6bf9dd3464db151ff34d0d70023_SeqId_44_ 2023-07-12 13:14:14,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/4f379a733bc74d3fbfbd4ea298dae334_SeqId_47_ into 8dbdd1e58659f82914d0046114f39095/family1 2023-07-12 13:14:14,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithWeeklyPolicy__smhuba2d393v2a7a176nh3rmt7pmgspmg6umac1ipijl8s8g0fkmbhscnmcuqmvm/family1/03c655dc6dce484695dd1e000bdc031b into 8dbdd1e58659f82914d0046114f39095/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/4f379a733bc74d3fbfbd4ea298dae334_SeqId_47_) 2023-07-12 13:14:14,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithWeeklyPolicy__smhuba2d393v2a7a176nh3rmt7pmgspmg6umac1ipijl8s8g0fkmbhscnmcuqmvm/family1/03c655dc6dce484695dd1e000bdc031b 2023-07-12 13:14:14,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 13:14:14,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 13:14:14,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(1912): 8dbdd1e58659f82914d0046114f39095/family1 is initiating minor compaction (all files) 2023-07-12 13:14:14,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@520375ae; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:14,515 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8dbdd1e58659f82914d0046114f39095/family1 in testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:14:14,515 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/3bf78528932b48f0b8a9875b77456f65, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/95a7d6ff3cf94da7801db13e708e140b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/4f379a733bc74d3fbfbd4ea298dae334_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp, totalSize=176.8 K 2023-07-12 13:14:14,515 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 3bf78528932b48f0b8a9875b77456f65, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837060 2023-07-12 13:14:14,516 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 95a7d6ff3cf94da7801db13e708e140b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237060 2023-07-12 13:14:14,516 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 4f379a733bc74d3fbfbd4ea298dae334_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965237060 2023-07-12 13:14:14,517 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-12 13:14:14,518 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:14,520 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201328474f17ae4432c84aa1622c5896db9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201328474f17ae4432c84aa1622c5896db9 2023-07-12 13:14:14,521 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052fe8114134c54afab25d0bb6a5047f60 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052fe8114134c54afab25d0bb6a5047f60 2023-07-12 13:14:14,521 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-07-12 13:14:14,521 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-12 13:14:14,521 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:14,521 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-12 13:14:14,522 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:14,523 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-12 13:14:14,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4740 sec 2023-07-12 13:14:14,538 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8dbdd1e58659f82914d0046114f39095#family1#compaction#35 average throughput is 14.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:14:14,637 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=252 (was 257), OpenFileDescriptor=587 (was 611), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=220 (was 223), ProcessCount=168 (was 168), AvailableMemoryMB=8218 (was 7796) - AvailableMemoryMB LEAK? - 2023-07-12 13:14:14,659 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=252, OpenFileDescriptor=587, MaxFileDescriptor=60000, SystemLoadAverage=220, ProcessCount=168, AvailableMemoryMB=8205 2023-07-12 13:14:14,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 13:14:14,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:14,665 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:14:14,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-07-12 13:14:14,666 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:14:14,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 13:14:14,672 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testScannerOnBulkLoadRefHFiles/0d3aa80d7fb53bdf2708c0638951744d 2023-07-12 13:14:14,673 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testScannerOnBulkLoadRefHFiles/0d3aa80d7fb53bdf2708c0638951744d empty. 2023-07-12 13:14:14,674 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testScannerOnBulkLoadRefHFiles/0d3aa80d7fb53bdf2708c0638951744d 2023-07-12 13:14:14,674 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b6038e0f3438cfc9edf31b7dc8e36aab 2023-07-12 13:14:14,674 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b6038e0f3438cfc9edf31b7dc8e36aab empty. 2023-07-12 13:14:14,674 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b6038e0f3438cfc9edf31b7dc8e36aab 2023-07-12 13:14:14,675 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2 2023-07-12 13:14:14,675 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2 empty. 2023-07-12 13:14:14,677 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2 2023-07-12 13:14:14,677 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-07-12 13:14:14,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 13:14:14,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 13:14:15,097 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-07-12 13:14:15,099 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0d3aa80d7fb53bdf2708c0638951744d, NAME => 'testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:14:15,102 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => b6038e0f3438cfc9edf31b7dc8e36aab, NAME => 'testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:14:15,103 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => d5f7aa412574761e5532007a732652e2, NAME => 'testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:14:15,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 13:14:15,513 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:15,513 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:15,513 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing b6038e0f3438cfc9edf31b7dc8e36aab, disabling compactions & flushes 2023-07-12 13:14:15,513 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 0d3aa80d7fb53bdf2708c0638951744d, disabling compactions & flushes 2023-07-12 13:14:15,513 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:14:15,514 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:14:15,514 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:14:15,514 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. after waiting 0 ms 2023-07-12 13:14:15,514 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:14:15,514 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:14:15,514 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:14:15,514 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for b6038e0f3438cfc9edf31b7dc8e36aab: 2023-07-12 13:14:15,514 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. after waiting 0 ms 2023-07-12 13:14:15,514 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:14:15,514 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:14:15,514 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 0d3aa80d7fb53bdf2708c0638951744d: 2023-07-12 13:14:15,515 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:15,515 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing d5f7aa412574761e5532007a732652e2, disabling compactions & flushes 2023-07-12 13:14:15,515 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:14:15,515 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:14:15,515 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. after waiting 0 ms 2023-07-12 13:14:15,515 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:14:15,515 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:14:15,515 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for d5f7aa412574761e5532007a732652e2: 2023-07-12 13:14:15,517 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:14:15,518 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689167655518"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167655518"}]},"ts":"1689167655518"} 2023-07-12 13:14:15,519 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689167655518"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167655518"}]},"ts":"1689167655518"} 2023-07-12 13:14:15,519 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689167655518"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167655518"}]},"ts":"1689167655518"} 2023-07-12 13:14:15,521 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-12 13:14:15,522 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:14:15,523 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167655522"}]},"ts":"1689167655522"} 2023-07-12 13:14:15,524 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-07-12 13:14:15,526 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0d3aa80d7fb53bdf2708c0638951744d, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b6038e0f3438cfc9edf31b7dc8e36aab, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d5f7aa412574761e5532007a732652e2, ASSIGN}] 2023-07-12 13:14:15,528 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d5f7aa412574761e5532007a732652e2, ASSIGN 2023-07-12 13:14:15,528 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b6038e0f3438cfc9edf31b7dc8e36aab, ASSIGN 2023-07-12 13:14:15,529 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0d3aa80d7fb53bdf2708c0638951744d, ASSIGN 2023-07-12 13:14:15,529 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d5f7aa412574761e5532007a732652e2, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:14:15,529 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b6038e0f3438cfc9edf31b7dc8e36aab, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:14:15,529 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0d3aa80d7fb53bdf2708c0638951744d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:14:15,683 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=d5f7aa412574761e5532007a732652e2, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:15,683 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=0d3aa80d7fb53bdf2708c0638951744d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:15,683 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b6038e0f3438cfc9edf31b7dc8e36aab, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:15,684 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689167655683"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167655683"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167655683"}]},"ts":"1689167655683"} 2023-07-12 13:14:15,684 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689167655683"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167655683"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167655683"}]},"ts":"1689167655683"} 2023-07-12 13:14:15,684 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689167655683"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167655683"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167655683"}]},"ts":"1689167655683"} 2023-07-12 13:14:15,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure d5f7aa412574761e5532007a732652e2, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:14:15,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 0d3aa80d7fb53bdf2708c0638951744d, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:14:15,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure b6038e0f3438cfc9edf31b7dc8e36aab, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:14:15,762 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/.tmp/family1/bac407f0c0574fc8b3bc61863e7c6787 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/bac407f0c0574fc8b3bc61863e7c6787 2023-07-12 13:14:15,768 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8dbdd1e58659f82914d0046114f39095/family1 of 8dbdd1e58659f82914d0046114f39095 into bac407f0c0574fc8b3bc61863e7c6787(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:14:15,769 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:14:15,769 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1689167654514; duration=1sec 2023-07-12 13:14:15,769 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:15,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 13:14:15,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/3bf78528932b48f0b8a9875b77456f65, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/95a7d6ff3cf94da7801db13e708e140b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/4f379a733bc74d3fbfbd4ea298dae334_SeqId_47_] to archive 2023-07-12 13:14:15,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:15,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/3bf78528932b48f0b8a9875b77456f65 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/3bf78528932b48f0b8a9875b77456f65 2023-07-12 13:14:15,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/95a7d6ff3cf94da7801db13e708e140b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/95a7d6ff3cf94da7801db13e708e140b 2023-07-12 13:14:15,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/4f379a733bc74d3fbfbd4ea298dae334_SeqId_47_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/family1/4f379a733bc74d3fbfbd4ea298dae334_SeqId_47_ 2023-07-12 13:14:15,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:14:15,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5f7aa412574761e5532007a732652e2, NAME => 'testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 13:14:15,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles d5f7aa412574761e5532007a732652e2 2023-07-12 13:14:15,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:15,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for d5f7aa412574761e5532007a732652e2 2023-07-12 13:14:15,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for d5f7aa412574761e5532007a732652e2 2023-07-12 13:14:15,846 INFO [StoreOpener-d5f7aa412574761e5532007a732652e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d5f7aa412574761e5532007a732652e2 2023-07-12 13:14:15,848 DEBUG [StoreOpener-d5f7aa412574761e5532007a732652e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1 2023-07-12 13:14:15,848 DEBUG [StoreOpener-d5f7aa412574761e5532007a732652e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1 2023-07-12 13:14:15,849 INFO [StoreOpener-d5f7aa412574761e5532007a732652e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5f7aa412574761e5532007a732652e2 columnFamilyName family1 2023-07-12 13:14:15,851 INFO [StoreOpener-d5f7aa412574761e5532007a732652e2-1] regionserver.HStore(310): Store=d5f7aa412574761e5532007a732652e2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:14:15,851 INFO [StoreOpener-d5f7aa412574761e5532007a732652e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d5f7aa412574761e5532007a732652e2 2023-07-12 13:14:15,854 DEBUG [StoreOpener-d5f7aa412574761e5532007a732652e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family2 2023-07-12 13:14:15,854 DEBUG [StoreOpener-d5f7aa412574761e5532007a732652e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family2 2023-07-12 13:14:15,854 INFO [StoreOpener-d5f7aa412574761e5532007a732652e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5f7aa412574761e5532007a732652e2 columnFamilyName family2 2023-07-12 13:14:15,857 INFO [StoreOpener-d5f7aa412574761e5532007a732652e2-1] regionserver.HStore(310): Store=d5f7aa412574761e5532007a732652e2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:14:15,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2 2023-07-12 13:14:15,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2 2023-07-12 13:14:15,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:14:15,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for d5f7aa412574761e5532007a732652e2 2023-07-12 13:14:15,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:14:15,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened d5f7aa412574761e5532007a732652e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71332280, jitterRate=0.06293380260467529}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:14:15,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for d5f7aa412574761e5532007a732652e2: 2023-07-12 13:14:15,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2., pid=31, masterSystemTime=1689167655840 2023-07-12 13:14:15,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:14:15,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:14:15,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:14:15,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d3aa80d7fb53bdf2708c0638951744d, NAME => 'testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 13:14:15,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 0d3aa80d7fb53bdf2708c0638951744d 2023-07-12 13:14:15,870 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=d5f7aa412574761e5532007a732652e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:15,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:15,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0d3aa80d7fb53bdf2708c0638951744d 2023-07-12 13:14:15,870 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689167655870"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167655870"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167655870"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167655870"}]},"ts":"1689167655870"} 2023-07-12 13:14:15,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0d3aa80d7fb53bdf2708c0638951744d 2023-07-12 13:14:15,872 INFO [StoreOpener-0d3aa80d7fb53bdf2708c0638951744d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0d3aa80d7fb53bdf2708c0638951744d 2023-07-12 13:14:15,874 DEBUG [StoreOpener-0d3aa80d7fb53bdf2708c0638951744d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/0d3aa80d7fb53bdf2708c0638951744d/family1 2023-07-12 13:14:15,874 DEBUG [StoreOpener-0d3aa80d7fb53bdf2708c0638951744d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/0d3aa80d7fb53bdf2708c0638951744d/family1 2023-07-12 13:14:15,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=30 2023-07-12 13:14:15,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure d5f7aa412574761e5532007a732652e2, server=jenkins-hbase17.apache.org,41721,1689167613545 in 184 msec 2023-07-12 13:14:15,874 INFO [StoreOpener-0d3aa80d7fb53bdf2708c0638951744d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d3aa80d7fb53bdf2708c0638951744d columnFamilyName family1 2023-07-12 13:14:15,875 INFO [StoreOpener-0d3aa80d7fb53bdf2708c0638951744d-1] regionserver.HStore(310): Store=0d3aa80d7fb53bdf2708c0638951744d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:14:15,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d5f7aa412574761e5532007a732652e2, ASSIGN in 348 msec 2023-07-12 13:14:15,876 INFO [StoreOpener-0d3aa80d7fb53bdf2708c0638951744d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0d3aa80d7fb53bdf2708c0638951744d 2023-07-12 13:14:15,877 DEBUG [StoreOpener-0d3aa80d7fb53bdf2708c0638951744d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/0d3aa80d7fb53bdf2708c0638951744d/family2 2023-07-12 13:14:15,877 DEBUG [StoreOpener-0d3aa80d7fb53bdf2708c0638951744d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/0d3aa80d7fb53bdf2708c0638951744d/family2 2023-07-12 13:14:15,878 INFO [StoreOpener-0d3aa80d7fb53bdf2708c0638951744d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d3aa80d7fb53bdf2708c0638951744d columnFamilyName family2 2023-07-12 13:14:15,879 INFO [StoreOpener-0d3aa80d7fb53bdf2708c0638951744d-1] regionserver.HStore(310): Store=0d3aa80d7fb53bdf2708c0638951744d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:14:15,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/0d3aa80d7fb53bdf2708c0638951744d 2023-07-12 13:14:15,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/0d3aa80d7fb53bdf2708c0638951744d 2023-07-12 13:14:15,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:14:15,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0d3aa80d7fb53bdf2708c0638951744d 2023-07-12 13:14:15,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/0d3aa80d7fb53bdf2708c0638951744d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:14:15,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0d3aa80d7fb53bdf2708c0638951744d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59983313, jitterRate=-0.10617898404598236}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:14:15,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0d3aa80d7fb53bdf2708c0638951744d: 2023-07-12 13:14:15,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d., pid=32, masterSystemTime=1689167655840 2023-07-12 13:14:15,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:14:15,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:14:15,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:14:15,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b6038e0f3438cfc9edf31b7dc8e36aab, NAME => 'testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab.', STARTKEY => '1', ENDKEY => '2'} 2023-07-12 13:14:15,890 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=0d3aa80d7fb53bdf2708c0638951744d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:15,890 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689167655889"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167655889"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167655889"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167655889"}]},"ts":"1689167655889"} 2023-07-12 13:14:15,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles b6038e0f3438cfc9edf31b7dc8e36aab 2023-07-12 13:14:15,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:15,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for b6038e0f3438cfc9edf31b7dc8e36aab 2023-07-12 13:14:15,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for b6038e0f3438cfc9edf31b7dc8e36aab 2023-07-12 13:14:15,892 INFO [StoreOpener-b6038e0f3438cfc9edf31b7dc8e36aab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b6038e0f3438cfc9edf31b7dc8e36aab 2023-07-12 13:14:15,893 DEBUG [StoreOpener-b6038e0f3438cfc9edf31b7dc8e36aab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/b6038e0f3438cfc9edf31b7dc8e36aab/family1 2023-07-12 13:14:15,893 DEBUG [StoreOpener-b6038e0f3438cfc9edf31b7dc8e36aab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/b6038e0f3438cfc9edf31b7dc8e36aab/family1 2023-07-12 13:14:15,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=28 2023-07-12 13:14:15,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 0d3aa80d7fb53bdf2708c0638951744d, server=jenkins-hbase17.apache.org,41721,1689167613545 in 202 msec 2023-07-12 13:14:15,894 INFO [StoreOpener-b6038e0f3438cfc9edf31b7dc8e36aab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6038e0f3438cfc9edf31b7dc8e36aab columnFamilyName family1 2023-07-12 13:14:15,895 INFO [StoreOpener-b6038e0f3438cfc9edf31b7dc8e36aab-1] regionserver.HStore(310): Store=b6038e0f3438cfc9edf31b7dc8e36aab/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:14:15,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0d3aa80d7fb53bdf2708c0638951744d, ASSIGN in 367 msec 2023-07-12 13:14:15,895 INFO [StoreOpener-b6038e0f3438cfc9edf31b7dc8e36aab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b6038e0f3438cfc9edf31b7dc8e36aab 2023-07-12 13:14:15,896 DEBUG [StoreOpener-b6038e0f3438cfc9edf31b7dc8e36aab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/b6038e0f3438cfc9edf31b7dc8e36aab/family2 2023-07-12 13:14:15,896 DEBUG [StoreOpener-b6038e0f3438cfc9edf31b7dc8e36aab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/b6038e0f3438cfc9edf31b7dc8e36aab/family2 2023-07-12 13:14:15,897 INFO [StoreOpener-b6038e0f3438cfc9edf31b7dc8e36aab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6038e0f3438cfc9edf31b7dc8e36aab columnFamilyName family2 2023-07-12 13:14:15,898 INFO [StoreOpener-b6038e0f3438cfc9edf31b7dc8e36aab-1] regionserver.HStore(310): Store=b6038e0f3438cfc9edf31b7dc8e36aab/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:14:15,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/b6038e0f3438cfc9edf31b7dc8e36aab 2023-07-12 13:14:15,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/b6038e0f3438cfc9edf31b7dc8e36aab 2023-07-12 13:14:15,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:14:15,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for b6038e0f3438cfc9edf31b7dc8e36aab 2023-07-12 13:14:15,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/b6038e0f3438cfc9edf31b7dc8e36aab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:14:15,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened b6038e0f3438cfc9edf31b7dc8e36aab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63911795, jitterRate=-0.04764004051685333}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:14:15,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for b6038e0f3438cfc9edf31b7dc8e36aab: 2023-07-12 13:14:15,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab., pid=33, masterSystemTime=1689167655840 2023-07-12 13:14:15,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:14:15,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:14:15,909 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b6038e0f3438cfc9edf31b7dc8e36aab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:15,909 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689167655909"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167655909"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167655909"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167655909"}]},"ts":"1689167655909"} 2023-07-12 13:14:15,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=29 2023-07-12 13:14:15,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure b6038e0f3438cfc9edf31b7dc8e36aab, server=jenkins-hbase17.apache.org,41721,1689167613545 in 220 msec 2023-07-12 13:14:15,914 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-12 13:14:15,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b6038e0f3438cfc9edf31b7dc8e36aab, ASSIGN in 386 msec 2023-07-12 13:14:15,915 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:14:15,916 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167655915"}]},"ts":"1689167655915"} 2023-07-12 13:14:15,917 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-07-12 13:14:15,919 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:14:15,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2570 sec 2023-07-12 13:14:16,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 13:14:16,773 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-07-12 13:14:16,776 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-07-12 13:14:16,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:16,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:16,782 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-07-12 13:14:16,782 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:16,782 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-07-12 13:14:16,782 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-07-12 13:14:16,783 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:16,783 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:16,783 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:16,783 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:16,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:16,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:16,784 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:16,784 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:16,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:16,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:16,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:16,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:16,785 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:16,785 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:16,785 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-07-12 13:14:16,785 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:16,785 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-07-12 13:14:16,786 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:14:16,786 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. started... 2023-07-12 13:14:16,787 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0d3aa80d7fb53bdf2708c0638951744d: 2023-07-12 13:14:16,787 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:14:16,787 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. started... 2023-07-12 13:14:16,787 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:14:16,792 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:14:16,793 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:14:16,793 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:16,793 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:14:16,793 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d5f7aa412574761e5532007a732652e2 2/2 column families, dataSize=48 B heapSize=632 B 2023-07-12 13:14:16,793 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. started... 2023-07-12 13:14:16,794 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b6038e0f3438cfc9edf31b7dc8e36aab: 2023-07-12 13:14:16,794 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:14:16,794 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:14:17,207 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307129df8b4859a9e4501be04c5f3101d51d2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202307129df8b4859a9e4501be04c5f3101d51d2 2023-07-12 13:14:17,614 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/.tmp/family1/51ec6440aa74410888138f51dd9d5be8 2023-07-12 13:14:17,621 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/.tmp/family1/51ec6440aa74410888138f51dd9d5be8 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/51ec6440aa74410888138f51dd9d5be8 2023-07-12 13:14:17,626 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/51ec6440aa74410888138f51dd9d5be8, entries=1, sequenceid=5, filesize=4.9 K 2023-07-12 13:14:17,627 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for d5f7aa412574761e5532007a732652e2 in 834ms, sequenceid=5, compaction requested=false 2023-07-12 13:14:17,628 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d5f7aa412574761e5532007a732652e2: 2023-07-12 13:14:17,628 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:14:17,628 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:14:17,628 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:14:17,628 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,628 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-07-12 13:14:17,628 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-07-12 13:14:17,629 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,629 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:17,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:17,630 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,630 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:17,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:17,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:17,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:17,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-07-12 13:14:17,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73756683[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:17,631 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-07-12 13:14:17,631 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,632 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,632 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-07-12 13:14:17,632 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-07-12 13:14:17,632 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:17,632 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,632 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:17,633 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,633 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-07-12 13:14:17,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:17,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:17,633 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:17,633 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-07-12 13:14:17,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:17,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-07-12 13:14:17,635 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-07-12 13:14:17,635 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:17,635 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:17,635 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,635 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:17,636 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,636 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:17,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,636 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:17,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:17,637 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:17,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,638 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:17,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,641 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,641 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:17,641 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:17,641 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-07-12 13:14:17,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:17,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-07-12 13:14:17,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:17,641 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:17,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:17,641 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,641 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,641 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,641 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,641 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,641 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:17,641 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:17,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:17,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:17,742 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:17,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:17,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:17,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:17,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,753 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-07-12 13:14:17,753 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:17,753 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-07-12 13:14:17,753 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-07-12 13:14:17,754 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,754 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,755 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:17,755 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:17,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:17,755 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:17,755 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:17,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,756 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,756 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-07-12 13:14:17,756 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:17,756 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-07-12 13:14:17,756 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:17,756 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-07-12 13:14:17,757 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:14:17,757 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. started... 2023-07-12 13:14:17,757 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:14:17,757 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. started... 2023-07-12 13:14:17,757 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0d3aa80d7fb53bdf2708c0638951744d: 2023-07-12 13:14:17,757 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:14:17,757 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:17,757 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:14:17,757 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d5f7aa412574761e5532007a732652e2 2/2 column families, dataSize=90 B heapSize=752 B 2023-07-12 13:14:17,757 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:14:17,757 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. started... 2023-07-12 13:14:17,757 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:14:17,757 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b6038e0f3438cfc9edf31b7dc8e36aab: 2023-07-12 13:14:17,757 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:14:17,757 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:14:18,171 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071216b50d88da474b1f95782176b667801c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023071216b50d88da474b1f95782176b667801c 2023-07-12 13:14:18,577 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/.tmp/family1/76529a61a52b469088510116a0011dc8 2023-07-12 13:14:18,584 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/.tmp/family1/76529a61a52b469088510116a0011dc8 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/76529a61a52b469088510116a0011dc8 2023-07-12 13:14:18,590 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/76529a61a52b469088510116a0011dc8, entries=2, sequenceid=9, filesize=5.0 K 2023-07-12 13:14:18,591 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for d5f7aa412574761e5532007a732652e2 in 834ms, sequenceid=9, compaction requested=false 2023-07-12 13:14:18,591 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d5f7aa412574761e5532007a732652e2: 2023-07-12 13:14:18,591 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:14:18,591 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:14:18,591 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:14:18,592 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,592 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-07-12 13:14:18,592 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-07-12 13:14:18,593 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,593 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:18,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:18,594 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,594 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:18,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:18,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:18,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:18,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-07-12 13:14:18,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ee88517[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:18,595 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-07-12 13:14:18,595 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,596 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,596 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-07-12 13:14:18,596 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-07-12 13:14:18,596 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:18,596 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,596 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:18,597 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-07-12 13:14:18,597 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,597 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:18,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:18,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:18,597 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-07-12 13:14:18,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:18,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:18,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:18,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-07-12 13:14:18,601 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-07-12 13:14:18,602 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:18,602 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:18,602 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,602 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:18,603 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,603 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:18,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:18,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,603 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:18,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:18,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:18,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:18,604 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:18,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,606 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:18,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,609 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,609 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,609 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,609 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:18,609 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:18,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:18,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:18,609 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-07-12 13:14:18,609 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,609 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:18,609 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,610 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,610 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:18,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-07-12 13:14:18,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:18,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:18,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:18,610 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:18,610 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:18,710 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:18,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:18,723 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-07-12 13:14:18,729 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-07-12 13:14:18,730 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-07-12 13:14:18,731 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:18,731 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168258731 2023-07-12 13:14:18,732 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-12 13:14:18,732 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-07-12 13:14:18,732 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-07-12 13:14:18,733 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x0af2126e to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:14:18,737 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69ee00fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:14:18,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230712 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-07-12 13:14:19,182 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712b623a9e27e504b6397c5a973376c7137 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230712b623a9e27e504b6397c5a973376c7137 2023-07-12 13:14:19,183 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230712 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-07-12 13:14:19,197 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:14:19,198 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:14:19,207 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:14:19,209 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:14:19,220 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230712/family1/f6ab3ee5de4b4c9ea292e590c8c6bdad first=Optional[k0] last=Optional[k1] 2023-07-12 13:14:19,221 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230712/family1/f6ab3ee5de4b4c9ea292e590c8c6bdad}] 2023-07-12 13:14:19,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230712/family1/f6ab3ee5de4b4c9ea292e590c8c6bdad for inclusion in d5f7aa412574761e5532007a732652e2/family1 2023-07-12 13:14:19,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-07-12 13:14:19,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-12 13:14:19,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for d5f7aa412574761e5532007a732652e2: 2023-07-12 13:14:19,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230712/family1/f6ab3ee5de4b4c9ea292e590c8c6bdad to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testScannerOnBulkLoadRefHFiles__h14uetrqu7l7mv5233n9u9lac6uk1855mt6dvh44ugk42f9qkfiaukj9i52iqd09/family1/f6ab3ee5de4b4c9ea292e590c8c6bdad 2023-07-12 13:14:19,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testScannerOnBulkLoadRefHFiles__h14uetrqu7l7mv5233n9u9lac6uk1855mt6dvh44ugk42f9qkfiaukj9i52iqd09/family1/f6ab3ee5de4b4c9ea292e590c8c6bdad as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/780cffac2581423db5047aaf39568d75_SeqId_12_ 2023-07-12 13:14:19,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testScannerOnBulkLoadRefHFiles__h14uetrqu7l7mv5233n9u9lac6uk1855mt6dvh44ugk42f9qkfiaukj9i52iqd09/family1/f6ab3ee5de4b4c9ea292e590c8c6bdad into d5f7aa412574761e5532007a732652e2/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/780cffac2581423db5047aaf39568d75_SeqId_12_ - updating store file list. 2023-07-12 13:14:19,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/780cffac2581423db5047aaf39568d75_SeqId_12_ into d5f7aa412574761e5532007a732652e2/family1 2023-07-12 13:14:19,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testScannerOnBulkLoadRefHFiles__h14uetrqu7l7mv5233n9u9lac6uk1855mt6dvh44ugk42f9qkfiaukj9i52iqd09/family1/f6ab3ee5de4b4c9ea292e590c8c6bdad into d5f7aa412574761e5532007a732652e2/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/780cffac2581423db5047aaf39568d75_SeqId_12_) 2023-07-12 13:14:19,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testScannerOnBulkLoadRefHFiles__h14uetrqu7l7mv5233n9u9lac6uk1855mt6dvh44ugk42f9qkfiaukj9i52iqd09/family1/f6ab3ee5de4b4c9ea292e590c8c6bdad 2023-07-12 13:14:19,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 13:14:19,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 13:14:19,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(1912): d5f7aa412574761e5532007a732652e2/family1 is initiating minor compaction (all files) 2023-07-12 13:14:19,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@51648217; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:19,241 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d5f7aa412574761e5532007a732652e2/family1 in testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:14:19,241 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/51ec6440aa74410888138f51dd9d5be8, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/76529a61a52b469088510116a0011dc8, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/780cffac2581423db5047aaf39568d75_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/.tmp, totalSize=15.1 K 2023-07-12 13:14:19,242 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 51ec6440aa74410888138f51dd9d5be8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167656773 2023-07-12 13:14:19,242 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 76529a61a52b469088510116a0011dc8, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167656773 2023-07-12 13:14:19,242 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 780cffac2581423db5047aaf39568d75_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167656773 2023-07-12 13:14:19,243 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230712 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-07-12 13:14:19,244 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:19,246 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023071216b50d88da474b1f95782176b667801c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023071216b50d88da474b1f95782176b667801c 2023-07-12 13:14:19,247 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202307129df8b4859a9e4501be04c5f3101d51d2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202307129df8b4859a9e4501be04c5f3101d51d2 2023-07-12 13:14:19,247 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-07-12 13:14:19,247 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230712' 2023-07-12 13:14:19,247 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230712 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-07-12 13:14:19,247 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-07-12 13:14:19,247 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:19,249 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-07-12 13:14:19,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 524 msec 2023-07-12 13:14:19,253 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): d5f7aa412574761e5532007a732652e2#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:14:19,292 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=252 (was 252), OpenFileDescriptor=591 (was 587) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 220) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=8099 (was 8205) 2023-07-12 13:14:19,303 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=252, OpenFileDescriptor=591, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=168, AvailableMemoryMB=8099 2023-07-12 13:14:19,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-12 13:14:19,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:19,307 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:14:19,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-07-12 13:14:19,308 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:14:19,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-12 13:14:19,309 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50 2023-07-12 13:14:19,310 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50 empty. 2023-07-12 13:14:19,310 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50 2023-07-12 13:14:19,310 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-07-12 13:14:19,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-12 13:14:19,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-12 13:14:19,720 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-07-12 13:14:19,722 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => b4c48074f460d6e2d7b4c30203b98f50, NAME => 'testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:14:19,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-12 13:14:20,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:20,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing b4c48074f460d6e2d7b4c30203b98f50, disabling compactions & flushes 2023-07-12 13:14:20,132 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:20,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:20,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. after waiting 0 ms 2023-07-12 13:14:20,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:20,133 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:20,133 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:20,137 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:14:20,139 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689167660139"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167660139"}]},"ts":"1689167660139"} 2023-07-12 13:14:20,142 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 13:14:20,143 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:14:20,143 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167660143"}]},"ts":"1689167660143"} 2023-07-12 13:14:20,145 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-07-12 13:14:20,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=b4c48074f460d6e2d7b4c30203b98f50, ASSIGN}] 2023-07-12 13:14:20,150 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=b4c48074f460d6e2d7b4c30203b98f50, ASSIGN 2023-07-12 13:14:20,151 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=b4c48074f460d6e2d7b4c30203b98f50, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:14:20,302 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b4c48074f460d6e2d7b4c30203b98f50, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:20,302 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689167660302"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167660302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167660302"}]},"ts":"1689167660302"} 2023-07-12 13:14:20,304 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure b4c48074f460d6e2d7b4c30203b98f50, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:14:20,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-12 13:14:20,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:20,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b4c48074f460d6e2d7b4c30203b98f50, NAME => 'testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:14:20,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy b4c48074f460d6e2d7b4c30203b98f50 2023-07-12 13:14:20,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:20,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for b4c48074f460d6e2d7b4c30203b98f50 2023-07-12 13:14:20,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for b4c48074f460d6e2d7b4c30203b98f50 2023-07-12 13:14:20,468 INFO [StoreOpener-b4c48074f460d6e2d7b4c30203b98f50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b4c48074f460d6e2d7b4c30203b98f50 2023-07-12 13:14:20,470 DEBUG [StoreOpener-b4c48074f460d6e2d7b4c30203b98f50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1 2023-07-12 13:14:20,470 DEBUG [StoreOpener-b4c48074f460d6e2d7b4c30203b98f50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1 2023-07-12 13:14:20,471 INFO [StoreOpener-b4c48074f460d6e2d7b4c30203b98f50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4c48074f460d6e2d7b4c30203b98f50 columnFamilyName family1 2023-07-12 13:14:20,474 INFO [StoreOpener-b4c48074f460d6e2d7b4c30203b98f50-1] regionserver.HStore(310): Store=b4c48074f460d6e2d7b4c30203b98f50/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:14:20,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50 2023-07-12 13:14:20,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50 2023-07-12 13:14:20,479 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/.tmp/family1/aa3a6d28c725498c92fa325d91274cdb as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/aa3a6d28c725498c92fa325d91274cdb 2023-07-12 13:14:20,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for b4c48074f460d6e2d7b4c30203b98f50 2023-07-12 13:14:20,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:14:20,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened b4c48074f460d6e2d7b4c30203b98f50; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62107231, jitterRate=-0.07453013956546783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:14:20,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:20,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50., pid=37, masterSystemTime=1689167660457 2023-07-12 13:14:20,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:20,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:20,495 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d5f7aa412574761e5532007a732652e2/family1 of d5f7aa412574761e5532007a732652e2 into aa3a6d28c725498c92fa325d91274cdb(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:14:20,495 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b4c48074f460d6e2d7b4c30203b98f50, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:20,495 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d5f7aa412574761e5532007a732652e2: 2023-07-12 13:14:20,495 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1689167659241; duration=1sec 2023-07-12 13:14:20,495 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689167660494"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167660494"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167660494"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167660494"}]},"ts":"1689167660494"} 2023-07-12 13:14:20,495 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:20,501 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-12 13:14:20,501 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure b4c48074f460d6e2d7b4c30203b98f50, server=jenkins-hbase17.apache.org,41721,1689167613545 in 195 msec 2023-07-12 13:14:20,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-07-12 13:14:20,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=b4c48074f460d6e2d7b4c30203b98f50, ASSIGN in 353 msec 2023-07-12 13:14:20,504 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:14:20,504 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167660504"}]},"ts":"1689167660504"} 2023-07-12 13:14:20,505 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-07-12 13:14:20,507 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:14:20,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.2020 sec 2023-07-12 13:14:20,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/51ec6440aa74410888138f51dd9d5be8, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/76529a61a52b469088510116a0011dc8, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/780cffac2581423db5047aaf39568d75_SeqId_12_] to archive 2023-07-12 13:14:20,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:20,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/51ec6440aa74410888138f51dd9d5be8 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/51ec6440aa74410888138f51dd9d5be8 2023-07-12 13:14:20,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/76529a61a52b469088510116a0011dc8 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/76529a61a52b469088510116a0011dc8 2023-07-12 13:14:20,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/780cffac2581423db5047aaf39568d75_SeqId_12_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/family1/780cffac2581423db5047aaf39568d75_SeqId_12_ 2023-07-12 13:14:21,375 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 13:14:21,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-12 13:14:21,416 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-07-12 13:14:21,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:21,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:21,441 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:21,441 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:21,441 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:21,441 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:21,441 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:21,442 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:21,442 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:21,442 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:21,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:21,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:21,442 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:21,442 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:21,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:21,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:21,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:21,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:21,443 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:21,443 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:21,443 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:21,443 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:21,444 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:21,444 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:21,444 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:21,444 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:21,444 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. started... 2023-07-12 13:14:21,445 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b4c48074f460d6e2d7b4c30203b98f50 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-12 13:14:21,870 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130747ca142e10e4a18be7d04811e57e596 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130747ca142e10e4a18be7d04811e57e596 2023-07-12 13:14:22,277 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/2aa569c2af624709bdb2945fbc262a3c 2023-07-12 13:14:22,291 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/2aa569c2af624709bdb2945fbc262a3c as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/2aa569c2af624709bdb2945fbc262a3c 2023-07-12 13:14:22,299 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/2aa569c2af624709bdb2945fbc262a3c, entries=1000, sequenceid=5, filesize=165.1 K 2023-07-12 13:14:22,300 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b4c48074f460d6e2d7b4c30203b98f50 in 856ms, sequenceid=5, compaction requested=false 2023-07-12 13:14:22,300 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:22,300 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:22,300 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:22,301 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:22,301 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:22,301 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,301 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:22,301 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:22,302 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,302 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:22,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:22,302 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,302 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:22,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:22,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:22,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:22,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:22,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53f7d90[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:22,304 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:22,304 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,305 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,305 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:22,305 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:22,305 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:22,305 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,305 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:22,306 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,306 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:22,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:22,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:22,306 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:22,306 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:22,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:22,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:22,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:22,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:22,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:22,308 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:22,308 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:22,308 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:22,308 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,308 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:22,309 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,309 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:22,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:22,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,309 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:22,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:22,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:22,309 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:22,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:22,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,310 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:22,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,311 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,311 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,311 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:22,311 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,311 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:22,311 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:22,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-12 13:14:22,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:22,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:22,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:22,311 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:22,311 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,312 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,312 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:22,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:22,312 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:22,312 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:22,412 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:22,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:22,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:22,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:22,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,427 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:22,427 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:22,427 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:22,427 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:22,428 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,428 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,429 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:22,429 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:22,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:22,430 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:22,430 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:22,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:22,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,432 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,432 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:22,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:22,432 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:22,432 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:22,432 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:22,432 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:22,433 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:22,433 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:22,433 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. started... 2023-07-12 13:14:22,433 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b4c48074f460d6e2d7b4c30203b98f50 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-12 13:14:22,853 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112833c5c54f60914461a3da75de71541418 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112833c5c54f60914461a3da75de71541418 2023-07-12 13:14:23,267 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/55549194f27d4f6d97b3f29ebf7f421e 2023-07-12 13:14:23,272 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/55549194f27d4f6d97b3f29ebf7f421e as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/55549194f27d4f6d97b3f29ebf7f421e 2023-07-12 13:14:23,279 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/55549194f27d4f6d97b3f29ebf7f421e, entries=1, sequenceid=9, filesize=5.0 K 2023-07-12 13:14:23,280 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b4c48074f460d6e2d7b4c30203b98f50 in 847ms, sequenceid=9, compaction requested=false 2023-07-12 13:14:23,280 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:23,280 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:23,280 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:23,280 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:23,280 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,280 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:23,280 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:23,282 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,282 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:23,282 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,282 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:23,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:23,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@236a83dd[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:23,285 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:23,285 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,286 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,287 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:23,287 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:23,287 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,287 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:23,287 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:23,288 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:23,288 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,288 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:23,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:23,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:23,288 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:23,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:23,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:23,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:23,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:23,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:23,291 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:23,292 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:23,292 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:23,292 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,292 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:23,293 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,293 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:23,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:23,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,294 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:23,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:23,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:23,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:23,295 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:23,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,297 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:23,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,299 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,299 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,299 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:23,299 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:23,299 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,300 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:23,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:23,300 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:23,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:23,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:23,300 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,300 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,300 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:23,300 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,300 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:23,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:23,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:23,401 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:23,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:23,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:23,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:23,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,408 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:23,408 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:23,408 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:23,408 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:23,408 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,408 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,409 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,409 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:23,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:23,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:23,409 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,409 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:23,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:23,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,410 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,410 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:23,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,410 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:23,410 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:23,410 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:23,410 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:23,411 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:23,411 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:23,411 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. started... 2023-07-12 13:14:23,411 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b4c48074f460d6e2d7b4c30203b98f50 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:23,424 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201bdf2178dd11a4e07a4826fda9c011af4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201bdf2178dd11a4e07a4826fda9c011af4 2023-07-12 13:14:23,830 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/0966ac7b88564c7ca1a037e775319bf7 2023-07-12 13:14:23,835 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/0966ac7b88564c7ca1a037e775319bf7 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/0966ac7b88564c7ca1a037e775319bf7 2023-07-12 13:14:23,842 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/0966ac7b88564c7ca1a037e775319bf7, entries=1, sequenceid=13, filesize=4.9 K 2023-07-12 13:14:23,843 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b4c48074f460d6e2d7b4c30203b98f50 in 432ms, sequenceid=13, compaction requested=true 2023-07-12 13:14:23,843 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:23,843 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:23,843 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:23,843 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:23,843 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,843 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:23,843 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:23,844 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,844 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:23,845 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,845 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:23,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:23,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b73a84d[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:23,846 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:23,846 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,847 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,847 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:23,847 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:23,847 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:23,847 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,847 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:23,848 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,848 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:23,848 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:23,848 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:23,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:23,851 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:23,851 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:23,851 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:23,851 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,851 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:23,852 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,852 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,852 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:23,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:23,853 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:23,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:23,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:23,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,854 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,858 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:23,858 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:23,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:23,858 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:23,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:23,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:23,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-12 13:14:23,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:23,859 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:23,859 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:23,860 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,860 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,860 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,860 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,860 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,860 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,860 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,959 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:23,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:23,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:23,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:23,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,966 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:23,966 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:23,966 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:23,966 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:23,967 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,967 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,968 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,968 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:23,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:23,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:23,968 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:23,968 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:23,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,969 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,969 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:23,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:23,969 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:23,969 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:23,969 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:23,969 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:23,969 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:23,969 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:23,969 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. started... 2023-07-12 13:14:23,970 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b4c48074f460d6e2d7b4c30203b98f50 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:24,386 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120537ed30292c934d6cbaa8bb49f005d343 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120537ed30292c934d6cbaa8bb49f005d343 2023-07-12 13:14:24,794 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/eeecccd01f81474e9da04f74af8909f1 2023-07-12 13:14:24,801 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/eeecccd01f81474e9da04f74af8909f1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/eeecccd01f81474e9da04f74af8909f1 2023-07-12 13:14:24,807 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/eeecccd01f81474e9da04f74af8909f1, entries=1, sequenceid=17, filesize=4.9 K 2023-07-12 13:14:24,808 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b4c48074f460d6e2d7b4c30203b98f50 in 839ms, sequenceid=17, compaction requested=true 2023-07-12 13:14:24,808 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:24,808 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:24,808 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:24,808 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:24,808 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,808 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:24,808 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:24,810 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,810 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:24,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:24,811 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,811 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:24,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:24,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:24,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:24,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:24,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11d94a09[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:24,813 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:24,813 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,814 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,815 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:24,815 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:24,815 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:24,815 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,815 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:24,816 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,816 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:24,816 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:24,816 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:24,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:24,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:24,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:24,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:24,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:24,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:24,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:24,821 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:24,821 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:24,822 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:24,822 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,822 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:24,823 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,823 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:24,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:24,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,823 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:24,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:24,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:24,824 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:24,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:24,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,825 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,828 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,828 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:24,828 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:24,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:24,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:24,828 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:24,828 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:24,828 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,828 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,828 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:24,828 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,828 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:24,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:24,828 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,829 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,929 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:24,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:24,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:24,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:24,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,941 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:24,942 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:24,942 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:24,942 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:24,942 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,942 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,945 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:24,945 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:24,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:24,945 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:24,945 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:24,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:24,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,946 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,946 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:24,947 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:24,947 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:24,947 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:24,947 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:24,947 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:24,947 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:24,947 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:24,947 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. started... 2023-07-12 13:14:24,947 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b4c48074f460d6e2d7b4c30203b98f50 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:25,366 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228eec23bdce35145749a1eeb638c0b4d56 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228eec23bdce35145749a1eeb638c0b4d56 2023-07-12 13:14:25,774 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/bf1730897f88479aa6c1b2e1ab2f9917 2023-07-12 13:14:25,783 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/bf1730897f88479aa6c1b2e1ab2f9917 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/bf1730897f88479aa6c1b2e1ab2f9917 2023-07-12 13:14:25,787 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/bf1730897f88479aa6c1b2e1ab2f9917, entries=1, sequenceid=21, filesize=4.9 K 2023-07-12 13:14:25,788 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b4c48074f460d6e2d7b4c30203b98f50 in 841ms, sequenceid=21, compaction requested=true 2023-07-12 13:14:25,788 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:25,788 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:25,788 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:25,789 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:25,789 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,789 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:25,789 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:25,819 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,819 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:25,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:25,819 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,819 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:25,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:25,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:25,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:25,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:25,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f74765f[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:25,823 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:25,823 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,824 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,825 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:25,825 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:25,825 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:25,825 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,825 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:25,826 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,826 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:25,826 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:25,827 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:25,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:25,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:25,832 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:25,832 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:25,832 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:25,832 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,832 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:25,834 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,834 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:25,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:25,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,834 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:25,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:25,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:25,835 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:25,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,836 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:25,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,838 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,838 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,838 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:25,838 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,838 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:25,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-12 13:14:25,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:25,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:25,838 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:25,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:25,838 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:25,839 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,839 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,839 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:25,839 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:25,839 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:25,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:25,939 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:25,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:25,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:25,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:25,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,957 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:25,957 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:25,957 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:25,957 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:25,958 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,958 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,959 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:25,959 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:25,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:25,960 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:25,960 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:25,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,961 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,963 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,963 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:25,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:25,963 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:25,963 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:25,963 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:25,963 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:25,964 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:25,964 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:25,964 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. started... 2023-07-12 13:14:25,964 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b4c48074f460d6e2d7b4c30203b98f50 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:26,384 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231aa8cf8f91e424cc488be38de72ccd684 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231aa8cf8f91e424cc488be38de72ccd684 2023-07-12 13:14:26,790 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/76bf5147381f42348e2760e37c8d701b 2023-07-12 13:14:26,795 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/76bf5147381f42348e2760e37c8d701b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/76bf5147381f42348e2760e37c8d701b 2023-07-12 13:14:26,799 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/76bf5147381f42348e2760e37c8d701b, entries=1, sequenceid=25, filesize=4.9 K 2023-07-12 13:14:26,800 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b4c48074f460d6e2d7b4c30203b98f50 in 836ms, sequenceid=25, compaction requested=true 2023-07-12 13:14:26,800 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:26,800 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:26,800 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:26,800 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:26,800 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,800 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:26,800 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:26,802 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,802 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:26,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:26,802 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,802 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:26,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:26,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:26,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:26,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:26,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18f77407[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:26,804 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:26,804 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,805 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,805 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:26,805 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:26,805 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:26,805 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,805 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:26,806 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:26,806 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,806 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:26,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:26,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:26,806 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:26,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:26,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:26,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:26,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:26,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:26,809 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:26,809 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:26,809 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:26,809 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,809 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:26,811 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,811 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:26,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:26,811 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:26,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:26,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:26,811 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:26,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:26,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,813 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:26,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,815 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,815 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:26,815 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:26,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:26,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:26,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:26,815 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:26,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-12 13:14:26,815 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,815 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:26,816 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,816 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:26,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:26,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:26,816 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:26,816 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,817 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,817 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,917 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:26,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:26,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:26,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:26,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,925 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:26,925 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:26,925 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:26,925 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:26,926 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,926 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,927 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:26,927 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:26,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:26,928 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:26,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,928 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:26,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:26,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,929 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,929 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:26,929 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:26,929 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:26,929 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:26,929 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:26,930 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:26,930 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:26,930 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:26,930 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. started... 2023-07-12 13:14:26,930 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b4c48074f460d6e2d7b4c30203b98f50 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:27,354 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101e7748696e0cd48a2a6f6ec7d0f29048a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101e7748696e0cd48a2a6f6ec7d0f29048a 2023-07-12 13:14:27,761 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/6b06f3b34f134a519ff11e4b56c08f4b 2023-07-12 13:14:27,772 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/6b06f3b34f134a519ff11e4b56c08f4b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/6b06f3b34f134a519ff11e4b56c08f4b 2023-07-12 13:14:27,780 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/6b06f3b34f134a519ff11e4b56c08f4b, entries=1, sequenceid=29, filesize=4.9 K 2023-07-12 13:14:27,781 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b4c48074f460d6e2d7b4c30203b98f50 in 851ms, sequenceid=29, compaction requested=true 2023-07-12 13:14:27,781 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:27,781 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:27,781 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:27,781 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:27,782 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,782 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:27,782 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:27,784 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,784 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:27,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:27,784 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,784 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:27,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:27,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:27,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:27,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:27,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ea08694[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:27,786 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:27,786 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,787 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,787 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:27,787 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:27,787 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:27,787 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,787 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:27,788 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:27,788 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:27,788 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:27,788 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:27,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:27,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:27,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:27,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:27,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:27,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:27,790 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:27,790 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:27,790 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:27,790 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,790 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:27,791 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,791 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,791 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:27,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:27,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:27,792 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:27,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,793 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:27,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,796 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,796 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,796 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:27,796 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:27,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:27,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-12 13:14:27,796 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,796 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:27,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:27,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:27,796 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:27,796 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:27,796 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:27,796 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:27,797 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:27,797 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,897 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:27,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:27,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:27,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:27,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,906 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:27,906 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:27,907 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:27,907 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:27,908 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,908 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,909 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:27,909 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:27,910 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:27,910 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,911 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,912 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:27,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:27,912 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:27,912 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:27,912 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:27,912 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:27,913 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:27,913 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:27,913 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. started... 2023-07-12 13:14:27,913 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b4c48074f460d6e2d7b4c30203b98f50 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:28,334 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031646c0f88c0f479e9e860ee95e92359d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601031646c0f88c0f479e9e860ee95e92359d 2023-07-12 13:14:28,342 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/a6798ed0a28d4b0d8f1c910ecf154f59 2023-07-12 13:14:28,348 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/a6798ed0a28d4b0d8f1c910ecf154f59 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/a6798ed0a28d4b0d8f1c910ecf154f59 2023-07-12 13:14:28,355 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/a6798ed0a28d4b0d8f1c910ecf154f59, entries=1, sequenceid=33, filesize=4.9 K 2023-07-12 13:14:28,356 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b4c48074f460d6e2d7b4c30203b98f50 in 443ms, sequenceid=33, compaction requested=true 2023-07-12 13:14:28,356 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:28,356 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:28,356 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:28,356 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:28,356 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,356 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:28,356 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:28,358 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,358 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:28,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:28,358 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,358 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:28,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:28,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:28,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:28,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:28,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2572024b[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:28,361 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:28,361 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,362 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,362 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:28,362 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:28,362 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:28,362 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,362 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:28,363 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,363 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:28,363 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:28,363 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:28,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:28,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:28,366 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:28,367 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:28,367 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:28,367 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,367 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:28,368 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,368 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:28,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:28,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,368 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:28,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:28,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:28,369 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:28,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:28,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,371 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:28,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,374 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,374 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:28,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:28,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:28,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:28,374 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:28,374 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:28,374 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:28,374 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,374 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:28,375 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:28,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:28,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:28,374 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,375 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,375 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,375 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,475 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:28,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:28,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:28,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:28,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,488 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:28,488 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:28,488 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:28,488 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:28,489 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,489 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,489 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,489 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:28,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:28,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:28,490 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:28,490 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:28,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:28,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,491 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,491 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:28,491 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:28,491 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:28,491 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:28,491 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:28,491 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:28,491 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:28,491 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:28,491 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. started... 2023-07-12 13:14:28,491 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b4c48074f460d6e2d7b4c30203b98f50 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:28,913 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907cf8bb0c5822b466fa15bdff657cbd9d5 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907cf8bb0c5822b466fa15bdff657cbd9d5 2023-07-12 13:14:29,320 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/3e5906c380004031bd15c815194cae3c 2023-07-12 13:14:29,331 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/3e5906c380004031bd15c815194cae3c as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/3e5906c380004031bd15c815194cae3c 2023-07-12 13:14:29,337 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/3e5906c380004031bd15c815194cae3c, entries=1, sequenceid=37, filesize=4.9 K 2023-07-12 13:14:29,338 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b4c48074f460d6e2d7b4c30203b98f50 in 847ms, sequenceid=37, compaction requested=true 2023-07-12 13:14:29,338 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:29,338 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:29,338 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:29,338 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:29,338 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,338 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:29,338 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:29,340 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,340 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:29,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:29,340 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,340 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:29,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:29,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:29,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:29,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:29,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69f84e34[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:29,342 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:29,342 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,343 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,343 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:29,343 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:29,343 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,344 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:29,343 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:29,345 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,345 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:29,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:29,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:29,345 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:29,345 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:29,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:29,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:29,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:29,349 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:29,349 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:29,349 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:29,349 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,349 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:29,351 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,351 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:29,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:29,351 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:29,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:29,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:29,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:29,352 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:29,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,354 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:29,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,356 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,356 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,356 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:29,356 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:29,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:29,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:29,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:29,356 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:29,356 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:29,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:29,356 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:29,357 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:29,357 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,357 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:29,357 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,357 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,458 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:29,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:29,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:29,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:29,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,470 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:29,470 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:29,470 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-12 13:14:29,470 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-12 13:14:29,471 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,471 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,472 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,472 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:29,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:29,473 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:29,473 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:29,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,475 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,475 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-12 13:14:29,475 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:29,475 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-12 13:14:29,476 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:29,476 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-12 13:14:29,476 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:29,476 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:29,476 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:29,476 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. started... 2023-07-12 13:14:29,476 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b4c48074f460d6e2d7b4c30203b98f50 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:29,893 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120f4dd32d6486e4545842452c0b2acf73b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120f4dd32d6486e4545842452c0b2acf73b 2023-07-12 13:14:30,301 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/1178df37d0874c1d826429c5974b5ea8 2023-07-12 13:14:30,306 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/1178df37d0874c1d826429c5974b5ea8 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/1178df37d0874c1d826429c5974b5ea8 2023-07-12 13:14:30,312 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/1178df37d0874c1d826429c5974b5ea8, entries=1, sequenceid=41, filesize=4.9 K 2023-07-12 13:14:30,313 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b4c48074f460d6e2d7b4c30203b98f50 in 837ms, sequenceid=41, compaction requested=true 2023-07-12 13:14:30,313 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:30,313 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:30,313 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:30,313 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:30,313 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,313 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-12 13:14:30,313 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-12 13:14:30,315 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,315 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:30,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:30,315 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,315 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:30,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:30,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-12 13:14:30,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a0c5840[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:30,317 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-12 13:14:30,317 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,318 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,318 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-12 13:14:30,318 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-12 13:14:30,318 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:30,318 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,318 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:30,319 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,319 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-12 13:14:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:30,319 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:30,319 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-12 13:14:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:30,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:14:30,321 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-12 13:14:30,321 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:30,321 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:30,321 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,321 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:30,322 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,322 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,322 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:30,323 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:30,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,324 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:30,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,326 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,326 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,326 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:30,326 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-12 13:14:30,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:30,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-12 13:14:30,326 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:30,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:30,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:30,326 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:30,326 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:30,326 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:30,326 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:30,326 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,326 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:30,326 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:30,426 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:30,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:30,432 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-07-12 13:14:30,436 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-12 13:14:30,437 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-12 13:14:30,438 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168270438 2023-07-12 13:14:30,438 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:30,442 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-12 13:14:30,444 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-07-12 13:14:30,444 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-12 13:14:30,444 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x5a2a2afc to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:14:30,450 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@540d1867, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:14:30,450 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:31,309 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010371d38db5ca7f449fa4d77614b65e10b9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010371d38db5ca7f449fa4d77614b65e10b9 2023-07-12 13:14:31,310 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-12 13:14:31,324 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:14:31,324 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:14:31,331 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:14:31,332 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:14:31,341 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/07b72b7b2a2e48d5a6105844717ff3ec first=Optional[r3] last=Optional[r6] 2023-07-12 13:14:31,342 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/07b72b7b2a2e48d5a6105844717ff3ec}] 2023-07-12 13:14:31,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/07b72b7b2a2e48d5a6105844717ff3ec for inclusion in b4c48074f460d6e2d7b4c30203b98f50/family1 2023-07-12 13:14:31,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-12 13:14:31,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:14:31,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:31,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/07b72b7b2a2e48d5a6105844717ff3ec to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8n59ftil41i7dmfjj10ah9s6phqtr8vbml4cbl1o1dsbds0gan643uk6ka806obu/family1/07b72b7b2a2e48d5a6105844717ff3ec 2023-07-12 13:14:31,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8n59ftil41i7dmfjj10ah9s6phqtr8vbml4cbl1o1dsbds0gan643uk6ka806obu/family1/07b72b7b2a2e48d5a6105844717ff3ec as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/daa24b682f6548a3925b6f703d5f05f7_SeqId_44_ 2023-07-12 13:14:31,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8n59ftil41i7dmfjj10ah9s6phqtr8vbml4cbl1o1dsbds0gan643uk6ka806obu/family1/07b72b7b2a2e48d5a6105844717ff3ec into b4c48074f460d6e2d7b4c30203b98f50/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/daa24b682f6548a3925b6f703d5f05f7_SeqId_44_ - updating store file list. 2023-07-12 13:14:31,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/daa24b682f6548a3925b6f703d5f05f7_SeqId_44_ into b4c48074f460d6e2d7b4c30203b98f50/family1 2023-07-12 13:14:31,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8n59ftil41i7dmfjj10ah9s6phqtr8vbml4cbl1o1dsbds0gan643uk6ka806obu/family1/07b72b7b2a2e48d5a6105844717ff3ec into b4c48074f460d6e2d7b4c30203b98f50/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/daa24b682f6548a3925b6f703d5f05f7_SeqId_44_) 2023-07-12 13:14:31,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8n59ftil41i7dmfjj10ah9s6phqtr8vbml4cbl1o1dsbds0gan643uk6ka806obu/family1/07b72b7b2a2e48d5a6105844717ff3ec 2023-07-12 13:14:31,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-12 13:14:31,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-12 13:14:31,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(1912): b4c48074f460d6e2d7b4c30203b98f50/family1 is initiating minor compaction 2023-07-12 13:14:31,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3f01d991; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:31,366 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b4c48074f460d6e2d7b4c30203b98f50/family1 in testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:31,366 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/55549194f27d4f6d97b3f29ebf7f421e, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/0966ac7b88564c7ca1a037e775319bf7, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/eeecccd01f81474e9da04f74af8909f1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/bf1730897f88479aa6c1b2e1ab2f9917, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/76bf5147381f42348e2760e37c8d701b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/6b06f3b34f134a519ff11e4b56c08f4b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/a6798ed0a28d4b0d8f1c910ecf154f59, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/3e5906c380004031bd15c815194cae3c, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/1178df37d0874c1d826429c5974b5ea8, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/daa24b682f6548a3925b6f703d5f05f7_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp, totalSize=50.0 K 2023-07-12 13:14:31,366 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 55549194f27d4f6d97b3f29ebf7f421e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-12 13:14:31,367 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 0966ac7b88564c7ca1a037e775319bf7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-12 13:14:31,367 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting eeecccd01f81474e9da04f74af8909f1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-12 13:14:31,367 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting bf1730897f88479aa6c1b2e1ab2f9917, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-12 13:14:31,367 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 76bf5147381f42348e2760e37c8d701b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-12 13:14:31,367 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 6b06f3b34f134a519ff11e4b56c08f4b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-12 13:14:31,367 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting a6798ed0a28d4b0d8f1c910ecf154f59, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-12 13:14:31,367 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 3e5906c380004031bd15c815194cae3c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-12 13:14:31,367 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 1178df37d0874c1d826429c5974b5ea8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-12 13:14:31,367 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting daa24b682f6548a3925b6f703d5f05f7_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-12 13:14:31,369 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-12 13:14:31,370 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:31,372 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228eec23bdce35145749a1eeb638c0b4d56 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228eec23bdce35145749a1eeb638c0b4d56 2023-07-12 13:14:31,373 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231aa8cf8f91e424cc488be38de72ccd684 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231aa8cf8f91e424cc488be38de72ccd684 2023-07-12 13:14:31,375 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101e7748696e0cd48a2a6f6ec7d0f29048a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101e7748696e0cd48a2a6f6ec7d0f29048a 2023-07-12 13:14:31,377 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601031646c0f88c0f479e9e860ee95e92359d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601031646c0f88c0f479e9e860ee95e92359d 2023-07-12 13:14:31,377 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-07-12 13:14:31,377 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-12 13:14:31,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:31,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:31,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:31,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:31,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:31,379 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:31,379 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:31,379 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:31,428 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): b4c48074f460d6e2d7b4c30203b98f50#family1#compaction#49 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:14:32,256 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/64f017b5436647d9b6bbecfd089ffcc9 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/64f017b5436647d9b6bbecfd089ffcc9 2023-07-12 13:14:32,258 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120552aa3536b101479b8aa14edf37febc4e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120552aa3536b101479b8aa14edf37febc4e 2023-07-12 13:14:32,259 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-12 13:14:32,263 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b4c48074f460d6e2d7b4c30203b98f50/family1 of b4c48074f460d6e2d7b4c30203b98f50 into 64f017b5436647d9b6bbecfd089ffcc9(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:14:32,263 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:32,264 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1689167671366; duration=0sec 2023-07-12 13:14:32,264 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:32,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/55549194f27d4f6d97b3f29ebf7f421e, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/0966ac7b88564c7ca1a037e775319bf7, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/eeecccd01f81474e9da04f74af8909f1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/bf1730897f88479aa6c1b2e1ab2f9917, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/76bf5147381f42348e2760e37c8d701b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/6b06f3b34f134a519ff11e4b56c08f4b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/a6798ed0a28d4b0d8f1c910ecf154f59, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/3e5906c380004031bd15c815194cae3c, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/1178df37d0874c1d826429c5974b5ea8, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/daa24b682f6548a3925b6f703d5f05f7_SeqId_44_] to archive 2023-07-12 13:14:32,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:32,291 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ea1da2bf208f4b468aadba6f28c2d073 first=Optional[r00] last=Optional[r2] 2023-07-12 13:14:32,292 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ea1da2bf208f4b468aadba6f28c2d073}] 2023-07-12 13:14:32,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/55549194f27d4f6d97b3f29ebf7f421e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/55549194f27d4f6d97b3f29ebf7f421e 2023-07-12 13:14:32,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ea1da2bf208f4b468aadba6f28c2d073 for inclusion in b4c48074f460d6e2d7b4c30203b98f50/family1 2023-07-12 13:14:32,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/0966ac7b88564c7ca1a037e775319bf7 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/0966ac7b88564c7ca1a037e775319bf7 2023-07-12 13:14:32,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/eeecccd01f81474e9da04f74af8909f1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/eeecccd01f81474e9da04f74af8909f1 2023-07-12 13:14:32,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/bf1730897f88479aa6c1b2e1ab2f9917 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/bf1730897f88479aa6c1b2e1ab2f9917 2023-07-12 13:14:32,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/76bf5147381f42348e2760e37c8d701b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/76bf5147381f42348e2760e37c8d701b 2023-07-12 13:14:32,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/6b06f3b34f134a519ff11e4b56c08f4b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/6b06f3b34f134a519ff11e4b56c08f4b 2023-07-12 13:14:32,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-07-12 13:14:32,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:14:32,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:32,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/a6798ed0a28d4b0d8f1c910ecf154f59 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/a6798ed0a28d4b0d8f1c910ecf154f59 2023-07-12 13:14:32,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ea1da2bf208f4b468aadba6f28c2d073 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lb58gckbpp378klc7p18cqiire22uimh15ijspr0gdsurikgdic3oc5vi24rio2v/family1/ea1da2bf208f4b468aadba6f28c2d073 2023-07-12 13:14:32,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/3e5906c380004031bd15c815194cae3c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/3e5906c380004031bd15c815194cae3c 2023-07-12 13:14:32,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/1178df37d0874c1d826429c5974b5ea8 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/1178df37d0874c1d826429c5974b5ea8 2023-07-12 13:14:32,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lb58gckbpp378klc7p18cqiire22uimh15ijspr0gdsurikgdic3oc5vi24rio2v/family1/ea1da2bf208f4b468aadba6f28c2d073 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/34541619ca3f4e5299a21eebe2af974e_SeqId_47_ 2023-07-12 13:14:32,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lb58gckbpp378klc7p18cqiire22uimh15ijspr0gdsurikgdic3oc5vi24rio2v/family1/ea1da2bf208f4b468aadba6f28c2d073 into b4c48074f460d6e2d7b4c30203b98f50/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/34541619ca3f4e5299a21eebe2af974e_SeqId_47_ - updating store file list. 2023-07-12 13:14:32,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/daa24b682f6548a3925b6f703d5f05f7_SeqId_44_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/daa24b682f6548a3925b6f703d5f05f7_SeqId_44_ 2023-07-12 13:14:32,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/34541619ca3f4e5299a21eebe2af974e_SeqId_47_ into b4c48074f460d6e2d7b4c30203b98f50/family1 2023-07-12 13:14:32,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lb58gckbpp378klc7p18cqiire22uimh15ijspr0gdsurikgdic3oc5vi24rio2v/family1/ea1da2bf208f4b468aadba6f28c2d073 into b4c48074f460d6e2d7b4c30203b98f50/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/34541619ca3f4e5299a21eebe2af974e_SeqId_47_) 2023-07-12 13:14:32,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lb58gckbpp378klc7p18cqiire22uimh15ijspr0gdsurikgdic3oc5vi24rio2v/family1/ea1da2bf208f4b468aadba6f28c2d073 2023-07-12 13:14:32,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 13:14:32,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 13:14:32,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(1912): b4c48074f460d6e2d7b4c30203b98f50/family1 is initiating minor compaction (all files) 2023-07-12 13:14:32,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@18341b5b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:32,314 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b4c48074f460d6e2d7b4c30203b98f50/family1 in testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:14:32,315 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/2aa569c2af624709bdb2945fbc262a3c, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/64f017b5436647d9b6bbecfd089ffcc9, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/34541619ca3f4e5299a21eebe2af974e_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp, totalSize=337.0 K 2023-07-12 13:14:32,315 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 2aa569c2af624709bdb2945fbc262a3c, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837060 2023-07-12 13:14:32,316 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 64f017b5436647d9b6bbecfd089ffcc9, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237060 2023-07-12 13:14:32,316 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 34541619ca3f4e5299a21eebe2af974e_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878837060 2023-07-12 13:14:32,318 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-12 13:14:32,319 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:32,321 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130747ca142e10e4a18be7d04811e57e596 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130747ca142e10e4a18be7d04811e57e596 2023-07-12 13:14:32,325 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201bdf2178dd11a4e07a4826fda9c011af4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201bdf2178dd11a4e07a4826fda9c011af4 2023-07-12 13:14:32,326 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120537ed30292c934d6cbaa8bb49f005d343 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120537ed30292c934d6cbaa8bb49f005d343 2023-07-12 13:14:32,326 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-07-12 13:14:32,327 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-12 13:14:32,327 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-12 13:14:32,327 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-12 13:14:32,327 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:32,331 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-12 13:14:32,334 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8970 sec 2023-07-12 13:14:32,342 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): b4c48074f460d6e2d7b4c30203b98f50#family1#compaction#50 average throughput is 15.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:14:32,450 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=254 (was 252) - Thread LEAK? -, OpenFileDescriptor=622 (was 591) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=213 (was 243), ProcessCount=166 (was 168), AvailableMemoryMB=8017 (was 8099) 2023-07-12 13:14:32,462 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=254, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=213, ProcessCount=166, AvailableMemoryMB=8016 2023-07-12 13:14:32,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-12 13:14:32,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:32,467 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:14:32,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-07-12 13:14:32,468 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:14:32,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-12 13:14:32,469 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:32,469 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1 empty. 2023-07-12 13:14:32,470 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:32,470 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-07-12 13:14:32,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-12 13:14:32,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-12 13:14:32,776 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/.tmp/family1/c0ca5f5d70f3437fb385751cbc9c9574 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/c0ca5f5d70f3437fb385751cbc9c9574 2023-07-12 13:14:32,785 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b4c48074f460d6e2d7b4c30203b98f50/family1 of b4c48074f460d6e2d7b4c30203b98f50 into c0ca5f5d70f3437fb385751cbc9c9574(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:14:32,785 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:14:32,785 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1689167672314; duration=0sec 2023-07-12 13:14:32,785 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:32,879 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-07-12 13:14:32,880 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2957a9c4bee7f52d38ac5e9cd8c8d4c1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:14:32,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/2aa569c2af624709bdb2945fbc262a3c, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/64f017b5436647d9b6bbecfd089ffcc9, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/34541619ca3f4e5299a21eebe2af974e_SeqId_47_] to archive 2023-07-12 13:14:32,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:32,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/2aa569c2af624709bdb2945fbc262a3c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/2aa569c2af624709bdb2945fbc262a3c 2023-07-12 13:14:32,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/64f017b5436647d9b6bbecfd089ffcc9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/64f017b5436647d9b6bbecfd089ffcc9 2023-07-12 13:14:32,895 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/34541619ca3f4e5299a21eebe2af974e_SeqId_47_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/family1/34541619ca3f4e5299a21eebe2af974e_SeqId_47_ 2023-07-12 13:14:33,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-12 13:14:33,293 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:33,293 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 2957a9c4bee7f52d38ac5e9cd8c8d4c1, disabling compactions & flushes 2023-07-12 13:14:33,293 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:33,293 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:33,293 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. after waiting 0 ms 2023-07-12 13:14:33,293 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:33,293 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:33,294 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:33,300 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:14:33,302 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689167673302"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167673302"}]},"ts":"1689167673302"} 2023-07-12 13:14:33,305 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 13:14:33,307 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:14:33,307 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167673307"}]},"ts":"1689167673307"} 2023-07-12 13:14:33,309 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-07-12 13:14:33,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2957a9c4bee7f52d38ac5e9cd8c8d4c1, ASSIGN}] 2023-07-12 13:14:33,313 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2957a9c4bee7f52d38ac5e9cd8c8d4c1, ASSIGN 2023-07-12 13:14:33,314 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2957a9c4bee7f52d38ac5e9cd8c8d4c1, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:14:33,465 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=2957a9c4bee7f52d38ac5e9cd8c8d4c1, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:33,466 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689167673465"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167673465"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167673465"}]},"ts":"1689167673465"} 2023-07-12 13:14:33,470 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 2957a9c4bee7f52d38ac5e9cd8c8d4c1, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:14:33,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-12 13:14:33,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:33,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2957a9c4bee7f52d38ac5e9cd8c8d4c1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:14:33,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:33,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:33,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:33,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:33,630 INFO [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:33,632 DEBUG [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 2023-07-12 13:14:33,633 DEBUG [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 2023-07-12 13:14:33,633 INFO [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2957a9c4bee7f52d38ac5e9cd8c8d4c1 columnFamilyName family1 2023-07-12 13:14:33,636 INFO [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] regionserver.HStore(310): Store=2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:14:33,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:33,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:33,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:33,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:14:33,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 2957a9c4bee7f52d38ac5e9cd8c8d4c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63942662, jitterRate=-0.04718008637428284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:14:33,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:33,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1., pid=41, masterSystemTime=1689167673623 2023-07-12 13:14:33,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:33,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:33,648 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=2957a9c4bee7f52d38ac5e9cd8c8d4c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:33,648 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689167673648"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167673648"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167673648"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167673648"}]},"ts":"1689167673648"} 2023-07-12 13:14:33,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-07-12 13:14:33,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 2957a9c4bee7f52d38ac5e9cd8c8d4c1, server=jenkins-hbase17.apache.org,41721,1689167613545 in 181 msec 2023-07-12 13:14:33,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-07-12 13:14:33,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2957a9c4bee7f52d38ac5e9cd8c8d4c1, ASSIGN in 340 msec 2023-07-12 13:14:33,654 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:14:33,654 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167673654"}]},"ts":"1689167673654"} 2023-07-12 13:14:33,655 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-07-12 13:14:33,657 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:14:33,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1920 sec 2023-07-12 13:14:34,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-12 13:14:34,577 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-07-12 13:14:34,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:34,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:34,611 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:34,611 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:34,612 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-12 13:14:34,612 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-12 13:14:34,612 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:34,612 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:34,613 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:34,613 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:34,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:34,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:34,613 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:34,613 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:34,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:34,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:34,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:34,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:34,614 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:34,614 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:34,614 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-12 13:14:34,614 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:34,614 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-12 13:14:34,614 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:34,614 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:34,614 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:34,614 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. started... 2023-07-12 13:14:34,615 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2957a9c4bee7f52d38ac5e9cd8c8d4c1 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-12 13:14:34,778 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:35,041 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511300956d7488e7e4ef29783d4c8feedf817 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511300956d7488e7e4ef29783d4c8feedf817 2023-07-12 13:14:35,446 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/703c2d2021104c7b92af7e232fe2a601 2023-07-12 13:14:35,453 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/703c2d2021104c7b92af7e232fe2a601 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/703c2d2021104c7b92af7e232fe2a601 2023-07-12 13:14:35,458 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/703c2d2021104c7b92af7e232fe2a601, entries=1000, sequenceid=5, filesize=191.4 K 2023-07-12 13:14:35,459 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 in 844ms, sequenceid=5, compaction requested=false 2023-07-12 13:14:35,459 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:35,460 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:35,460 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:35,460 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:35,460 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,460 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-12 13:14:35,460 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-12 13:14:35,461 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,461 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:35,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:35,461 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,462 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:35,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:35,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:35,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:35,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-12 13:14:35,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30e2f3b3[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:35,463 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-12 13:14:35,463 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,463 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,463 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-12 13:14:35,463 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-12 13:14:35,463 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,464 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:35,464 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:35,464 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,464 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-12 13:14:35,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,464 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:35,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:35,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:35,465 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-12 13:14:35,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:35,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:35,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:35,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:35,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-12 13:14:35,466 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-12 13:14:35,466 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:35,466 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:35,467 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,467 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:35,467 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,467 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,467 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:35,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:35,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:35,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:35,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:35,468 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:35,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:35,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,469 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:35,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,470 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,470 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:35,470 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:35,470 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:35,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:35,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:35,470 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:35,470 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-12 13:14:35,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:35,471 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:35,471 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:35,571 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:35,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:35,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:35,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:35,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,582 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:35,582 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:35,582 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-12 13:14:35,582 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-12 13:14:35,583 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,583 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,583 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:35,583 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:35,584 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:35,584 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,584 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,585 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-12 13:14:35,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:35,585 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-12 13:14:35,585 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:35,585 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-12 13:14:35,585 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:35,585 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:35,585 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:35,585 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. started... 2023-07-12 13:14:35,585 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2957a9c4bee7f52d38ac5e9cd8c8d4c1 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-12 13:14:35,999 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284b5a4eacc7d747009dd23249b2ec0537 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511284b5a4eacc7d747009dd23249b2ec0537 2023-07-12 13:14:36,406 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/2ad8c7342c1c4692a3c06b2f4b12838a 2023-07-12 13:14:36,411 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/2ad8c7342c1c4692a3c06b2f4b12838a as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/2ad8c7342c1c4692a3c06b2f4b12838a 2023-07-12 13:14:36,416 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/2ad8c7342c1c4692a3c06b2f4b12838a, entries=1, sequenceid=9, filesize=5.0 K 2023-07-12 13:14:36,417 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 in 832ms, sequenceid=9, compaction requested=false 2023-07-12 13:14:36,417 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:36,417 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:36,417 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:36,417 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:36,417 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,417 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-12 13:14:36,417 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-12 13:14:36,418 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,418 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:36,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:36,418 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:36,418 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:36,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:36,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:36,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-12 13:14:36,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@537dfbe[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:36,420 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-12 13:14:36,420 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,420 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,420 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-12 13:14:36,420 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-12 13:14:36,420 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,421 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:36,421 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:36,421 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-12 13:14:36,421 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,421 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:36,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:36,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:36,421 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-12 13:14:36,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:36,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:36,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:36,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:36,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-12 13:14:36,424 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-12 13:14:36,424 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:36,424 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:36,424 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,424 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:36,425 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,425 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:36,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:36,425 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:36,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:36,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:36,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:36,425 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:36,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,426 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:36,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,428 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,428 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,428 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:36,428 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:36,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-12 13:14:36,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:36,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:36,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:36,428 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:36,428 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,428 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:36,429 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,429 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:36,429 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:36,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:36,429 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:36,429 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,529 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:36,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:36,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:36,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:36,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,537 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:36,537 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:36,537 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-12 13:14:36,537 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-12 13:14:36,537 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,537 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,538 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:36,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:36,538 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:36,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,539 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,539 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:36,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:36,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,540 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,540 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-12 13:14:36,540 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,540 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-12 13:14:36,540 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:36,540 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-12 13:14:36,540 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:36,540 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:36,541 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:36,541 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. started... 2023-07-12 13:14:36,541 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2957a9c4bee7f52d38ac5e9cd8c8d4c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:36,955 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d15d87e091b145bf82bc6f4f4a33bca6 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201d15d87e091b145bf82bc6f4f4a33bca6 2023-07-12 13:14:36,961 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/3a2c31bda86441769223bc2eb5de4a65 2023-07-12 13:14:36,977 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/3a2c31bda86441769223bc2eb5de4a65 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/3a2c31bda86441769223bc2eb5de4a65 2023-07-12 13:14:36,982 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/3a2c31bda86441769223bc2eb5de4a65, entries=1, sequenceid=13, filesize=5.0 K 2023-07-12 13:14:36,983 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 in 442ms, sequenceid=13, compaction requested=true 2023-07-12 13:14:36,983 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:36,983 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:36,983 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:36,983 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:36,983 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,983 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-12 13:14:36,984 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-12 13:14:36,985 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:36,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:36,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:36,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:36,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,986 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:36,987 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,987 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:36,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-12 13:14:36,987 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-12 13:14:36,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e15b8c2[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:36,987 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,989 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,989 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-12 13:14:36,989 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-12 13:14:36,989 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:36,990 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,990 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:36,990 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,990 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-12 13:14:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:36,991 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:36,991 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-12 13:14:36,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:36,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:36,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:36,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:36,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-12 13:14:36,994 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-12 13:14:36,994 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:36,994 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:36,994 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,994 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:36,996 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,996 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:36,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,996 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:36,996 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:36,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,998 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:36,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:36,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:36,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:37,000 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:37,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:37,001 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:37,001 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:37,001 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,001 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,001 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,001 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,001 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,001 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,000 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:37,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:37,001 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:37,001 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:37,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:37,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:37,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-12 13:14:37,101 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:37,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:37,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:37,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:37,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,109 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:37,109 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:37,109 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-12 13:14:37,109 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-12 13:14:37,109 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,109 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,110 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:37,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:37,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:37,110 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,111 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,111 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:37,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:37,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,111 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,116 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-12 13:14:37,116 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,116 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-12 13:14:37,116 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:37,116 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-12 13:14:37,117 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:37,117 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:37,117 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:37,117 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. started... 2023-07-12 13:14:37,117 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2957a9c4bee7f52d38ac5e9cd8c8d4c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:37,537 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205041e12b45dd74ba1bd83faeaab839882 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205041e12b45dd74ba1bd83faeaab839882 2023-07-12 13:14:37,944 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/9b8bddd73e27441ea88c9f051830bea5 2023-07-12 13:14:37,951 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/9b8bddd73e27441ea88c9f051830bea5 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/9b8bddd73e27441ea88c9f051830bea5 2023-07-12 13:14:37,956 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/9b8bddd73e27441ea88c9f051830bea5, entries=1, sequenceid=17, filesize=5.0 K 2023-07-12 13:14:37,957 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 in 840ms, sequenceid=17, compaction requested=true 2023-07-12 13:14:37,957 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:37,957 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:37,957 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:37,957 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:37,957 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,957 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-12 13:14:37,957 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-12 13:14:37,958 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,958 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:37,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:37,959 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,959 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:37,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-12 13:14:37,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6733b18[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:37,960 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-12 13:14:37,960 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,961 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,961 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-12 13:14:37,961 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-12 13:14:37,961 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:37,961 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,961 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:37,962 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-12 13:14:37,962 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,962 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:37,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:37,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:37,962 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-12 13:14:37,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:37,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:37,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:37,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:37,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-12 13:14:37,964 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-12 13:14:37,964 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:37,964 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:37,964 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,964 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:37,966 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,966 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,966 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:37,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:37,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:37,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:37,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:37,966 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:37,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:37,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,967 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:37,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,969 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,969 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:37,969 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:37,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:37,969 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:37,969 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:37,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:37,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:37,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-12 13:14:37,969 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,970 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:37,970 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,970 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,970 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:37,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:37,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:37,970 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:37,970 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:38,070 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:38,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:38,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:38,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:38,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,077 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:38,077 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:38,077 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-12 13:14:38,077 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-12 13:14:38,077 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,077 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,078 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:38,078 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:38,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:38,078 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,078 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:38,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:38,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,079 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-12 13:14:38,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,079 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-12 13:14:38,079 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:38,079 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-12 13:14:38,079 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:38,080 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:38,080 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:38,080 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. started... 2023-07-12 13:14:38,080 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2957a9c4bee7f52d38ac5e9cd8c8d4c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:38,492 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c0c6119abd2540ab8188586dae218771 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228c0c6119abd2540ab8188586dae218771 2023-07-12 13:14:38,899 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/a9b66ce634d34dbcbd32d92c4fb0bc7e 2023-07-12 13:14:38,904 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/a9b66ce634d34dbcbd32d92c4fb0bc7e as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/a9b66ce634d34dbcbd32d92c4fb0bc7e 2023-07-12 13:14:38,908 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/a9b66ce634d34dbcbd32d92c4fb0bc7e, entries=1, sequenceid=21, filesize=5.0 K 2023-07-12 13:14:38,909 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 in 829ms, sequenceid=21, compaction requested=true 2023-07-12 13:14:38,909 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:38,909 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:38,909 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:38,909 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:38,909 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,909 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-12 13:14:38,909 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-12 13:14:38,911 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,911 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:38,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:38,911 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,911 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:38,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:38,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:38,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:38,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-12 13:14:38,912 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-12 13:14:38,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21ab2f0e[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:38,912 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,913 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,913 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-12 13:14:38,913 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-12 13:14:38,913 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,913 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:38,913 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:38,914 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-12 13:14:38,914 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,914 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:38,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:38,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:38,914 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-12 13:14:38,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:38,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:38,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:38,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-12 13:14:38,916 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-12 13:14:38,916 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:38,916 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:38,916 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,916 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:38,917 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,917 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:38,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:38,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,917 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:38,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:38,917 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:38,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:38,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:38,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,918 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:38,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,920 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,920 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:38,920 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,920 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:38,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:38,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:38,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:38,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:38,920 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,920 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-12 13:14:38,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:38,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:38,920 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:38,920 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:38,920 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:38,920 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,920 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:38,920 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:38,921 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,021 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:39,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:39,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:39,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:39,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,027 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:39,027 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:39,027 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-12 13:14:39,027 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-12 13:14:39,028 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,028 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,029 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,029 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:39,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:39,029 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,029 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,030 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,030 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-12 13:14:39,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,030 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-12 13:14:39,030 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:39,030 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-12 13:14:39,030 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:39,030 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:39,030 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:39,030 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. started... 2023-07-12 13:14:39,030 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2957a9c4bee7f52d38ac5e9cd8c8d4c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:39,173 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 13:14:39,221 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:14:39,221 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62035241 to 127.0.0.1:51470 2023-07-12 13:14:39,221 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:14:39,225 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:14:39,225 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0af2126e to 127.0.0.1:51470 2023-07-12 13:14:39,225 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:14:39,228 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:14:39,228 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a2a2afc to 127.0.0.1:51470 2023-07-12 13:14:39,228 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:14:39,442 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e1770bf8810a4fa6a1ccf3217405910d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231e1770bf8810a4fa6a1ccf3217405910d 2023-07-12 13:14:39,850 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/f319ed1c1320495aa62de53ef297f68f 2023-07-12 13:14:39,855 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/f319ed1c1320495aa62de53ef297f68f as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/f319ed1c1320495aa62de53ef297f68f 2023-07-12 13:14:39,860 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/f319ed1c1320495aa62de53ef297f68f, entries=1, sequenceid=25, filesize=5.0 K 2023-07-12 13:14:39,861 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 in 831ms, sequenceid=25, compaction requested=true 2023-07-12 13:14:39,861 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:39,861 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:39,861 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:39,861 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:39,861 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,861 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-12 13:14:39,861 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-12 13:14:39,862 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,863 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,863 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:39,864 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:39,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:39,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:39,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-12 13:14:39,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1adadeaa[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:39,866 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-12 13:14:39,866 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,866 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,867 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-12 13:14:39,867 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-12 13:14:39,867 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:39,871 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,871 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:39,871 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,872 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-12 13:14:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:39,872 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:39,872 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-12 13:14:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:39,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-12 13:14:39,874 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-12 13:14:39,874 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:39,874 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:39,874 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,874 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:39,875 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,875 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:39,875 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:39,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:39,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,875 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:39,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:39,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:39,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:39,876 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:39,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,877 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,878 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,878 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,878 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,878 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:39,877 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:39,878 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:39,878 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:39,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:39,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-12 13:14:39,878 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:39,878 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:39,878 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:39,878 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:39,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:39,978 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:39,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:39,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:39,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:39,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,984 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:39,985 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:39,985 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-12 13:14:39,985 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-12 13:14:39,985 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,985 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,986 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,986 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:39,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:39,986 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:39,986 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:39,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,987 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,987 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-12 13:14:39,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:39,987 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-12 13:14:39,987 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:39,987 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-12 13:14:39,987 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:39,987 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:39,987 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:39,987 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. started... 2023-07-12 13:14:39,987 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2957a9c4bee7f52d38ac5e9cd8c8d4c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:40,399 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a9cceb6b38e6487cb36fe08969a53537 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101a9cceb6b38e6487cb36fe08969a53537 2023-07-12 13:14:40,805 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/e7c4ca9dc83e48ea821d3ef6f58f9124 2023-07-12 13:14:40,811 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/e7c4ca9dc83e48ea821d3ef6f58f9124 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/e7c4ca9dc83e48ea821d3ef6f58f9124 2023-07-12 13:14:40,817 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/e7c4ca9dc83e48ea821d3ef6f58f9124, entries=1, sequenceid=29, filesize=5.0 K 2023-07-12 13:14:40,818 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 in 831ms, sequenceid=29, compaction requested=true 2023-07-12 13:14:40,818 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:40,818 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:40,818 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:40,818 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:40,818 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,818 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-12 13:14:40,818 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-12 13:14:40,820 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,820 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:40,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:40,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:40,821 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,821 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:40,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:40,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:40,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-12 13:14:40,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@190aa69b[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:40,823 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-12 13:14:40,824 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,824 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,825 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-12 13:14:40,825 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-12 13:14:40,825 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:40,825 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,825 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:40,827 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,827 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-12 13:14:40,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:40,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:40,827 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:40,827 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-12 13:14:40,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:40,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:40,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:40,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:40,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-12 13:14:40,831 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-12 13:14:40,831 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:40,831 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:40,831 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,831 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:40,833 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,833 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:40,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:40,833 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:40,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:40,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:40,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:40,834 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:40,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,836 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:40,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,839 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,839 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:40,839 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:40,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:40,839 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:40,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-12 13:14:40,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:40,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:40,839 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:40,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:40,839 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:40,840 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:40,840 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,840 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:40,840 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,840 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,840 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,940 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:40,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:40,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:40,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:40,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,947 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:40,947 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:40,947 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-12 13:14:40,947 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-12 13:14:40,947 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,947 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,948 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,948 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:40,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:40,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:40,948 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:40,948 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:40,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:40,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,949 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,949 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-12 13:14:40,949 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:40,949 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-12 13:14:40,949 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:40,949 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-12 13:14:40,949 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:40,949 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:40,949 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:40,950 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. started... 2023-07-12 13:14:40,950 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2957a9c4bee7f52d38ac5e9cd8c8d4c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:41,371 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010312c4821650d94a559882c0303c78a385 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010312c4821650d94a559882c0303c78a385 2023-07-12 13:14:41,778 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/1de858a3133847989370ec44a817728b 2023-07-12 13:14:41,786 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/1de858a3133847989370ec44a817728b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/1de858a3133847989370ec44a817728b 2023-07-12 13:14:41,793 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/1de858a3133847989370ec44a817728b, entries=1, sequenceid=33, filesize=5.0 K 2023-07-12 13:14:41,795 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 in 845ms, sequenceid=33, compaction requested=true 2023-07-12 13:14:41,795 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:41,795 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:41,795 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:41,795 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:41,795 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,795 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-12 13:14:41,795 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-12 13:14:41,797 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,797 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:41,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:41,798 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,798 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:41,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-12 13:14:41,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63ef559[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:41,800 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-12 13:14:41,800 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,801 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,801 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-12 13:14:41,801 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-12 13:14:41,801 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:41,801 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,802 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:41,802 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-12 13:14:41,803 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,803 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:41,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:41,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:41,803 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-12 13:14:41,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:41,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:41,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-12 13:14:41,808 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-12 13:14:41,808 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:41,808 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:41,808 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,808 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:41,810 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,810 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,810 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:41,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:41,811 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:41,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,813 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:41,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,816 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:41,816 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,816 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:41,816 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:41,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:41,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:41,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:41,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:41,816 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-12 13:14:41,816 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:41,816 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:41,817 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:41,816 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:41,817 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,817 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,817 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,917 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:41,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:41,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:41,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:41,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,923 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:41,923 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:41,923 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-12 13:14:41,923 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-12 13:14:41,924 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,924 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,924 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:41,924 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:41,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:41,925 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:41,925 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:41,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:41,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,925 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,926 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-12 13:14:41,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:41,926 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-12 13:14:41,926 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:41,926 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-12 13:14:41,926 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:41,926 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:41,926 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:41,926 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. started... 2023-07-12 13:14:41,926 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2957a9c4bee7f52d38ac5e9cd8c8d4c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:42,341 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074be4828dd46843f1b3fb335045b8a10b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509074be4828dd46843f1b3fb335045b8a10b 2023-07-12 13:14:42,747 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/966c4b30c25f480b85eacee33b70ebb7 2023-07-12 13:14:42,758 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/966c4b30c25f480b85eacee33b70ebb7 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/966c4b30c25f480b85eacee33b70ebb7 2023-07-12 13:14:42,764 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/966c4b30c25f480b85eacee33b70ebb7, entries=1, sequenceid=37, filesize=5.0 K 2023-07-12 13:14:42,765 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 in 839ms, sequenceid=37, compaction requested=true 2023-07-12 13:14:42,765 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:42,765 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:42,765 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:42,765 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:42,765 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,766 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-12 13:14:42,766 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-12 13:14:42,767 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,767 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:42,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:42,768 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,768 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:42,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:42,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:42,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:42,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-12 13:14:42,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e1569cf[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:42,770 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-12 13:14:42,770 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,770 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,771 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-12 13:14:42,771 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-12 13:14:42,771 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:42,771 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,771 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:42,772 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-12 13:14:42,772 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,772 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:42,772 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-12 13:14:42,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:42,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:42,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:42,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:42,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:42,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-12 13:14:42,775 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-12 13:14:42,775 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:42,775 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:42,775 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,775 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:42,776 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,776 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:42,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:42,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,776 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:42,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:42,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:42,777 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:42,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:42,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,778 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:42,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,781 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,781 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:42,781 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:42,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:42,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:42,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:42,781 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:42,781 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,781 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:42,781 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,781 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:42,781 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:42,782 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,782 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:42,782 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:42,882 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:42,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:42,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:42,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:42,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,893 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:42,893 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:42,893 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-12 13:14:42,893 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-12 13:14:42,894 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,894 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,895 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:42,895 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:42,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:42,896 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:42,896 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:42,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:42,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,897 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,898 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-12 13:14:42,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:42,898 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-12 13:14:42,898 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:42,898 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-12 13:14:42,898 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:42,898 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:42,898 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:42,898 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. started... 2023-07-12 13:14:42,899 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2957a9c4bee7f52d38ac5e9cd8c8d4c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:42,914 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c4b7994dc92b4c54ade78293d6770505 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c4b7994dc92b4c54ade78293d6770505 2023-07-12 13:14:43,321 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/f9d140e56ec7437db04c3cc87b49bf5d 2023-07-12 13:14:43,334 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/f9d140e56ec7437db04c3cc87b49bf5d as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/f9d140e56ec7437db04c3cc87b49bf5d 2023-07-12 13:14:43,343 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/f9d140e56ec7437db04c3cc87b49bf5d, entries=1, sequenceid=41, filesize=5.0 K 2023-07-12 13:14:43,345 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 in 446ms, sequenceid=41, compaction requested=true 2023-07-12 13:14:43,345 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:43,345 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:43,345 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:43,345 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:43,345 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,345 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-12 13:14:43,345 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-12 13:14:43,347 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,347 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:43,348 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,348 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:43,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:43,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-12 13:14:43,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32f6c729[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:43,352 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-12 13:14:43,352 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,353 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,353 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-12 13:14:43,353 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-12 13:14:43,353 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:43,354 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,354 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:43,355 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,355 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-12 13:14:43,355 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:43,355 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-12 13:14:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:43,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:43,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:43,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:43,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-12 13:14:43,360 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-12 13:14:43,360 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:43,360 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:43,360 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,360 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:43,362 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,362 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:43,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:43,362 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:43,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:43,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:43,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:43,364 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,366 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:43,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,371 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,371 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:43,371 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:43,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:43,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:43,371 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:43,371 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:43,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:43,372 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:43,372 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:43,372 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,373 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:43,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:43,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:43,373 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,373 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,373 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,473 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:43,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:43,475 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:43,478 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-12 13:14:43,479 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-12 13:14:43,480 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:43,480 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168283480 2023-07-12 13:14:43,485 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-12 13:14:43,486 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-07-12 13:14:43,486 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-12 13:14:43,486 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x2171388d to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:14:43,490 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29750d29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:14:43,491 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:44,337 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010373a000ace48341109d27cceeff9c0071 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010373a000ace48341109d27cceeff9c0071 2023-07-12 13:14:44,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-12 13:14:44,354 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:14:44,355 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:14:44,361 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:14:44,363 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:14:44,374 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/73e0b93ec57646b58b0432a17a5fd2b0 first=Optional[r3] last=Optional[r6] 2023-07-12 13:14:44,375 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/73e0b93ec57646b58b0432a17a5fd2b0}] 2023-07-12 13:14:44,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/73e0b93ec57646b58b0432a17a5fd2b0 for inclusion in 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 2023-07-12 13:14:44,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-12 13:14:44,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:14:44,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:44,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/73e0b93ec57646b58b0432a17a5fd2b0 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__h5s23k1gs6ie3u96cpkbba7c4r5f9ufsl5rbnpat6of2qt0sqv5difulb0i4v8at/family1/73e0b93ec57646b58b0432a17a5fd2b0 2023-07-12 13:14:44,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__h5s23k1gs6ie3u96cpkbba7c4r5f9ufsl5rbnpat6of2qt0sqv5difulb0i4v8at/family1/73e0b93ec57646b58b0432a17a5fd2b0 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/ca9d990bf6384f47bf59e01724b12579_SeqId_44_ 2023-07-12 13:14:44,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__h5s23k1gs6ie3u96cpkbba7c4r5f9ufsl5rbnpat6of2qt0sqv5difulb0i4v8at/family1/73e0b93ec57646b58b0432a17a5fd2b0 into 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/ca9d990bf6384f47bf59e01724b12579_SeqId_44_ - updating store file list. 2023-07-12 13:14:44,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/ca9d990bf6384f47bf59e01724b12579_SeqId_44_ into 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 2023-07-12 13:14:44,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__h5s23k1gs6ie3u96cpkbba7c4r5f9ufsl5rbnpat6of2qt0sqv5difulb0i4v8at/family1/73e0b93ec57646b58b0432a17a5fd2b0 into 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/ca9d990bf6384f47bf59e01724b12579_SeqId_44_) 2023-07-12 13:14:44,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__h5s23k1gs6ie3u96cpkbba7c4r5f9ufsl5rbnpat6of2qt0sqv5difulb0i4v8at/family1/73e0b93ec57646b58b0432a17a5fd2b0 2023-07-12 13:14:44,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-12 13:14:44,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-12 13:14:44,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(1912): 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 is initiating minor compaction 2023-07-12 13:14:44,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4a287f7f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:44,395 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:44,396 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/2ad8c7342c1c4692a3c06b2f4b12838a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/3a2c31bda86441769223bc2eb5de4a65, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/9b8bddd73e27441ea88c9f051830bea5, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/a9b66ce634d34dbcbd32d92c4fb0bc7e, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/f319ed1c1320495aa62de53ef297f68f, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/e7c4ca9dc83e48ea821d3ef6f58f9124, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/1de858a3133847989370ec44a817728b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/966c4b30c25f480b85eacee33b70ebb7, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/f9d140e56ec7437db04c3cc87b49bf5d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/ca9d990bf6384f47bf59e01724b12579_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp, totalSize=50.4 K 2023-07-12 13:14:44,396 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 2ad8c7342c1c4692a3c06b2f4b12838a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-12 13:14:44,396 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 3a2c31bda86441769223bc2eb5de4a65, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-12 13:14:44,396 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 9b8bddd73e27441ea88c9f051830bea5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-12 13:14:44,396 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting a9b66ce634d34dbcbd32d92c4fb0bc7e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-12 13:14:44,396 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting f319ed1c1320495aa62de53ef297f68f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-12 13:14:44,396 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting e7c4ca9dc83e48ea821d3ef6f58f9124, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-12 13:14:44,396 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 1de858a3133847989370ec44a817728b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-12 13:14:44,396 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 966c4b30c25f480b85eacee33b70ebb7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-12 13:14:44,396 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting f9d140e56ec7437db04c3cc87b49bf5d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-12 13:14:44,396 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting ca9d990bf6384f47bf59e01724b12579_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-12 13:14:44,397 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-12 13:14:44,398 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:44,400 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228c0c6119abd2540ab8188586dae218771 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228c0c6119abd2540ab8188586dae218771 2023-07-12 13:14:44,401 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231e1770bf8810a4fa6a1ccf3217405910d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231e1770bf8810a4fa6a1ccf3217405910d 2023-07-12 13:14:44,402 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101a9cceb6b38e6487cb36fe08969a53537 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101a9cceb6b38e6487cb36fe08969a53537 2023-07-12 13:14:44,403 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010312c4821650d94a559882c0303c78a385 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010312c4821650d94a559882c0303c78a385 2023-07-12 13:14:44,403 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-07-12 13:14:44,403 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-12 13:14:44,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:44,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:44,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:44,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:44,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:44,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:44,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:44,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:44,436 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2957a9c4bee7f52d38ac5e9cd8c8d4c1#family1#compaction#61 average throughput is 0.40 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:14:45,265 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/672056ffa7344629812acdcef09b8142 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/672056ffa7344629812acdcef09b8142 2023-07-12 13:14:45,269 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205aca251f23a3043619d87f1354c290123 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205aca251f23a3043619d87f1354c290123 2023-07-12 13:14:45,270 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 of 2957a9c4bee7f52d38ac5e9cd8c8d4c1 into 672056ffa7344629812acdcef09b8142(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:14:45,270 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:45,270 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-12 13:14:45,270 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1689167684395; duration=0sec 2023-07-12 13:14:45,270 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:45,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/2ad8c7342c1c4692a3c06b2f4b12838a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/3a2c31bda86441769223bc2eb5de4a65, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/9b8bddd73e27441ea88c9f051830bea5, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/a9b66ce634d34dbcbd32d92c4fb0bc7e, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/f319ed1c1320495aa62de53ef297f68f, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/e7c4ca9dc83e48ea821d3ef6f58f9124, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/1de858a3133847989370ec44a817728b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/966c4b30c25f480b85eacee33b70ebb7, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/f9d140e56ec7437db04c3cc87b49bf5d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/ca9d990bf6384f47bf59e01724b12579_SeqId_44_] to archive 2023-07-12 13:14:45,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:45,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/2ad8c7342c1c4692a3c06b2f4b12838a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/2ad8c7342c1c4692a3c06b2f4b12838a 2023-07-12 13:14:45,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/3a2c31bda86441769223bc2eb5de4a65 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/3a2c31bda86441769223bc2eb5de4a65 2023-07-12 13:14:45,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/9b8bddd73e27441ea88c9f051830bea5 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/9b8bddd73e27441ea88c9f051830bea5 2023-07-12 13:14:45,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/a9b66ce634d34dbcbd32d92c4fb0bc7e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/a9b66ce634d34dbcbd32d92c4fb0bc7e 2023-07-12 13:14:45,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/f319ed1c1320495aa62de53ef297f68f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/f319ed1c1320495aa62de53ef297f68f 2023-07-12 13:14:45,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/e7c4ca9dc83e48ea821d3ef6f58f9124 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/e7c4ca9dc83e48ea821d3ef6f58f9124 2023-07-12 13:14:45,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/1de858a3133847989370ec44a817728b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/1de858a3133847989370ec44a817728b 2023-07-12 13:14:45,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/966c4b30c25f480b85eacee33b70ebb7 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/966c4b30c25f480b85eacee33b70ebb7 2023-07-12 13:14:45,307 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/828f4eb573d848059437cf5b1528c09d first=Optional[r00] last=Optional[r2] 2023-07-12 13:14:45,308 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/828f4eb573d848059437cf5b1528c09d}] 2023-07-12 13:14:45,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/f9d140e56ec7437db04c3cc87b49bf5d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/f9d140e56ec7437db04c3cc87b49bf5d 2023-07-12 13:14:45,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/828f4eb573d848059437cf5b1528c09d for inclusion in 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 2023-07-12 13:14:45,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/ca9d990bf6384f47bf59e01724b12579_SeqId_44_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/ca9d990bf6384f47bf59e01724b12579_SeqId_44_ 2023-07-12 13:14:45,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-07-12 13:14:45,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:14:45,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:45,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/828f4eb573d848059437cf5b1528c09d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1bpn9d6dfmtm9jnigao0afso5qass1kksadn5nrfne91f84a6jv5asj8m2nskb23/family1/828f4eb573d848059437cf5b1528c09d 2023-07-12 13:14:45,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1bpn9d6dfmtm9jnigao0afso5qass1kksadn5nrfne91f84a6jv5asj8m2nskb23/family1/828f4eb573d848059437cf5b1528c09d as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/369e4ea238d541c5b34faf2a1b34d090_SeqId_47_ 2023-07-12 13:14:45,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1bpn9d6dfmtm9jnigao0afso5qass1kksadn5nrfne91f84a6jv5asj8m2nskb23/family1/828f4eb573d848059437cf5b1528c09d into 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/369e4ea238d541c5b34faf2a1b34d090_SeqId_47_ - updating store file list. 2023-07-12 13:14:45,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/369e4ea238d541c5b34faf2a1b34d090_SeqId_47_ into 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 2023-07-12 13:14:45,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1bpn9d6dfmtm9jnigao0afso5qass1kksadn5nrfne91f84a6jv5asj8m2nskb23/family1/828f4eb573d848059437cf5b1528c09d into 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/369e4ea238d541c5b34faf2a1b34d090_SeqId_47_) 2023-07-12 13:14:45,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1bpn9d6dfmtm9jnigao0afso5qass1kksadn5nrfne91f84a6jv5asj8m2nskb23/family1/828f4eb573d848059437cf5b1528c09d 2023-07-12 13:14:45,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 13:14:45,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 13:14:45,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(1912): 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 is initiating minor compaction (all files) 2023-07-12 13:14:45,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@27c38b94; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:45,323 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:45,323 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/703c2d2021104c7b92af7e232fe2a601, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/672056ffa7344629812acdcef09b8142, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/369e4ea238d541c5b34faf2a1b34d090_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp, totalSize=390.1 K 2023-07-12 13:14:45,323 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 703c2d2021104c7b92af7e232fe2a601, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837060 2023-07-12 13:14:45,324 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 672056ffa7344629812acdcef09b8142, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237060 2023-07-12 13:14:45,324 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 369e4ea238d541c5b34faf2a1b34d090_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878837060 2023-07-12 13:14:45,325 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-12 13:14:45,325 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:45,327 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511300956d7488e7e4ef29783d4c8feedf817 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511300956d7488e7e4ef29783d4c8feedf817 2023-07-12 13:14:45,328 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201d15d87e091b145bf82bc6f4f4a33bca6 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201d15d87e091b145bf82bc6f4f4a33bca6 2023-07-12 13:14:45,329 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205041e12b45dd74ba1bd83faeaab839882 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205041e12b45dd74ba1bd83faeaab839882 2023-07-12 13:14:45,329 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-07-12 13:14:45,329 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-12 13:14:45,330 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:45,330 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-12 13:14:45,330 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:45,331 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-12 13:14:45,333 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8550 sec 2023-07-12 13:14:45,343 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2957a9c4bee7f52d38ac5e9cd8c8d4c1#family1#compaction#62 average throughput is 18.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:14:45,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$12(2454): Client=jenkins//136.243.18.41 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-12 13:14:45,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:45,818 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-07-12 13:14:45,819 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-07-12 13:14:45,819 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-07-12 13:14:45,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-07-12 13:14:45,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2957a9c4bee7f52d38ac5e9cd8c8d4c1, REOPEN/MOVE}] 2023-07-12 13:14:45,826 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2957a9c4bee7f52d38ac5e9cd8c8d4c1, REOPEN/MOVE 2023-07-12 13:14:45,826 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=2957a9c4bee7f52d38ac5e9cd8c8d4c1, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:45,826 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689167685826"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167685826"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167685826"}]},"ts":"1689167685826"} 2023-07-12 13:14:45,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 2957a9c4bee7f52d38ac5e9cd8c8d4c1, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:14:45,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:45,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 2957a9c4bee7f52d38ac5e9cd8c8d4c1, disabling compactions & flushes 2023-07-12 13:14:45,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:46,571 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/.tmp/family1/7e740b6859674d0182842be42519b314 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/7e740b6859674d0182842be42519b314 2023-07-12 13:14:46,579 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 of 2957a9c4bee7f52d38ac5e9cd8c8d4c1 into 7e740b6859674d0182842be42519b314(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:14:46,579 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:46,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:46,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:46,580 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1689167685323; duration=1sec 2023-07-12 13:14:46,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. after waiting 0 ms 2023-07-12 13:14:46,580 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:46,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:46,581 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/703c2d2021104c7b92af7e232fe2a601, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/672056ffa7344629812acdcef09b8142, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/369e4ea238d541c5b34faf2a1b34d090_SeqId_47_] to archive 2023-07-12 13:14:46,582 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:46,585 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/703c2d2021104c7b92af7e232fe2a601 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/703c2d2021104c7b92af7e232fe2a601 2023-07-12 13:14:46,587 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/672056ffa7344629812acdcef09b8142 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/672056ffa7344629812acdcef09b8142 2023-07-12 13:14:46,589 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/369e4ea238d541c5b34faf2a1b34d090_SeqId_47_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/369e4ea238d541c5b34faf2a1b34d090_SeqId_47_ 2023-07-12 13:14:46,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-07-12 13:14:46,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:46,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:46,597 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 2957a9c4bee7f52d38ac5e9cd8c8d4c1 to self. 2023-07-12 13:14:46,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:46,599 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=2957a9c4bee7f52d38ac5e9cd8c8d4c1, regionState=CLOSED 2023-07-12 13:14:46,599 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689167686599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167686599"}]},"ts":"1689167686599"} 2023-07-12 13:14:46,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-07-12 13:14:46,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 2957a9c4bee7f52d38ac5e9cd8c8d4c1, server=jenkins-hbase17.apache.org,41721,1689167613545 in 771 msec 2023-07-12 13:14:46,603 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2957a9c4bee7f52d38ac5e9cd8c8d4c1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=true 2023-07-12 13:14:46,754 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=2957a9c4bee7f52d38ac5e9cd8c8d4c1, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:46,754 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689167686754"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167686754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167686754"}]},"ts":"1689167686754"} 2023-07-12 13:14:46,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 2957a9c4bee7f52d38ac5e9cd8c8d4c1, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:14:46,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:46,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2957a9c4bee7f52d38ac5e9cd8c8d4c1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:14:46,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:46,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:46,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:46,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:46,911 INFO [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:46,912 DEBUG [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 2023-07-12 13:14:46,912 DEBUG [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 2023-07-12 13:14:46,913 INFO [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2957a9c4bee7f52d38ac5e9cd8c8d4c1 columnFamilyName family1 2023-07-12 13:14:46,919 DEBUG [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/7e740b6859674d0182842be42519b314 2023-07-12 13:14:46,919 INFO [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] regionserver.HStore(310): Store=2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:14:46,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:46,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:46,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:46,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 2957a9c4bee7f52d38ac5e9cd8c8d4c1; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61079730, jitterRate=-0.0898410975933075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:14:46,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:46,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1., pid=47, masterSystemTime=1689167686907 2023-07-12 13:14:46,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:46,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:46,929 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=2957a9c4bee7f52d38ac5e9cd8c8d4c1, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:46,929 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689167686929"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167686929"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167686929"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167686929"}]},"ts":"1689167686929"} 2023-07-12 13:14:46,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-07-12 13:14:46,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 2957a9c4bee7f52d38ac5e9cd8c8d4c1, server=jenkins-hbase17.apache.org,41721,1689167613545 in 175 msec 2023-07-12 13:14:46,934 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-12 13:14:46,934 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2957a9c4bee7f52d38ac5e9cd8c8d4c1, REOPEN/MOVE in 1.1070 sec 2023-07-12 13:14:46,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-07-12 13:14:46,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1130 sec 2023-07-12 13:14:46,937 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5280 sec 2023-07-12 13:14:46,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-07-12 13:14:46,939 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(278): alter status finished 2023-07-12 13:14:46,940 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:46,941 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-12 13:14:46,942 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-12 13:14:46,942 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:46,942 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168286942 2023-07-12 13:14:46,943 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-12 13:14:46,944 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-07-12 13:14:46,944 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-12 13:14:46,944 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x3f0fc1a2 to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:14:46,947 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e929f2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:14:46,948 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:46,948 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:46,948 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:46,948 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:46,948 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:47,773 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112879769c6fde37423d9146fccabc4bebef to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112879769c6fde37423d9146fccabc4bebef 2023-07-12 13:14:47,774 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-12 13:14:47,787 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:14:47,789 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56682, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:14:47,797 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:14:47,799 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:14:47,809 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a92be175aaef46f6abac24eb6026e8f5 first=Optional[r05] last=Optional[r8] 2023-07-12 13:14:47,810 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a92be175aaef46f6abac24eb6026e8f5}] 2023-07-12 13:14:47,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a92be175aaef46f6abac24eb6026e8f5 for inclusion in 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 2023-07-12 13:14:47,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-07-12 13:14:47,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:14:47,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:47,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a92be175aaef46f6abac24eb6026e8f5 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__blcccafslidqmt3fks0o0r8aj4c9g19p8s1tb4g1ibsg66bms5mkjfcuvm308m7t/family1/a92be175aaef46f6abac24eb6026e8f5 2023-07-12 13:14:47,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__blcccafslidqmt3fks0o0r8aj4c9g19p8s1tb4g1ibsg66bms5mkjfcuvm308m7t/family1/a92be175aaef46f6abac24eb6026e8f5 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/081759cff4c14aa4ae357d313febddd7_SeqId_53_ 2023-07-12 13:14:47,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__blcccafslidqmt3fks0o0r8aj4c9g19p8s1tb4g1ibsg66bms5mkjfcuvm308m7t/family1/a92be175aaef46f6abac24eb6026e8f5 into 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/081759cff4c14aa4ae357d313febddd7_SeqId_53_ - updating store file list. 2023-07-12 13:14:47,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/081759cff4c14aa4ae357d313febddd7_SeqId_53_ into 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 2023-07-12 13:14:47,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__blcccafslidqmt3fks0o0r8aj4c9g19p8s1tb4g1ibsg66bms5mkjfcuvm308m7t/family1/a92be175aaef46f6abac24eb6026e8f5 into 2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/081759cff4c14aa4ae357d313febddd7_SeqId_53_) 2023-07-12 13:14:47,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__blcccafslidqmt3fks0o0r8aj4c9g19p8s1tb4g1ibsg66bms5mkjfcuvm308m7t/family1/a92be175aaef46f6abac24eb6026e8f5 2023-07-12 13:14:47,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-12 13:14:47,830 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:47,832 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c4b7994dc92b4c54ade78293d6770505 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c4b7994dc92b4c54ade78293d6770505 2023-07-12 13:14:47,833 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511284b5a4eacc7d747009dd23249b2ec0537 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511284b5a4eacc7d747009dd23249b2ec0537 2023-07-12 13:14:47,833 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-07-12 13:14:47,833 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-12 13:14:47,834 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:47,834 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:47,834 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:47,834 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-12 13:14:47,834 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:47,835 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-12 13:14:47,837 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 895 msec 2023-07-12 13:14:47,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$12(2454): Client=jenkins//136.243.18.41 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-12 13:14:47,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:48,310 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-07-12 13:14:48,311 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-07-12 13:14:48,311 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-07-12 13:14:48,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-07-12 13:14:48,315 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2957a9c4bee7f52d38ac5e9cd8c8d4c1, REOPEN/MOVE}] 2023-07-12 13:14:48,316 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2957a9c4bee7f52d38ac5e9cd8c8d4c1, REOPEN/MOVE 2023-07-12 13:14:48,317 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=2957a9c4bee7f52d38ac5e9cd8c8d4c1, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:48,317 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689167688317"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167688317"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167688317"}]},"ts":"1689167688317"} 2023-07-12 13:14:48,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 2957a9c4bee7f52d38ac5e9cd8c8d4c1, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:14:48,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:48,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 2957a9c4bee7f52d38ac5e9cd8c8d4c1, disabling compactions & flushes 2023-07-12 13:14:48,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:48,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:48,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. after waiting 0 ms 2023-07-12 13:14:48,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:48,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-07-12 13:14:48,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:48,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:48,479 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 2957a9c4bee7f52d38ac5e9cd8c8d4c1 to self. 2023-07-12 13:14:48,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:48,481 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=2957a9c4bee7f52d38ac5e9cd8c8d4c1, regionState=CLOSED 2023-07-12 13:14:48,481 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689167688481"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167688481"}]},"ts":"1689167688481"} 2023-07-12 13:14:48,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-12 13:14:48,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 2957a9c4bee7f52d38ac5e9cd8c8d4c1, server=jenkins-hbase17.apache.org,41721,1689167613545 in 164 msec 2023-07-12 13:14:48,484 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2957a9c4bee7f52d38ac5e9cd8c8d4c1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=true 2023-07-12 13:14:48,635 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=2957a9c4bee7f52d38ac5e9cd8c8d4c1, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:48,635 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689167688635"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167688635"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167688635"}]},"ts":"1689167688635"} 2023-07-12 13:14:48,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 2957a9c4bee7f52d38ac5e9cd8c8d4c1, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:14:48,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:48,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2957a9c4bee7f52d38ac5e9cd8c8d4c1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:14:48,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:48,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:48,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:48,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:48,796 INFO [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:48,797 DEBUG [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 2023-07-12 13:14:48,797 DEBUG [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1 2023-07-12 13:14:48,797 INFO [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2957a9c4bee7f52d38ac5e9cd8c8d4c1 columnFamilyName family1 2023-07-12 13:14:48,803 DEBUG [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/081759cff4c14aa4ae357d313febddd7_SeqId_53_ 2023-07-12 13:14:48,806 DEBUG [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1/7e740b6859674d0182842be42519b314 2023-07-12 13:14:48,806 INFO [StoreOpener-2957a9c4bee7f52d38ac5e9cd8c8d4c1-1] regionserver.HStore(310): Store=2957a9c4bee7f52d38ac5e9cd8c8d4c1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:14:48,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:48,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:48,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:14:48,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 2957a9c4bee7f52d38ac5e9cd8c8d4c1; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60580320, jitterRate=-0.09728288650512695}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:14:48,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:14:48,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1., pid=53, masterSystemTime=1689167688789 2023-07-12 13:14:48,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:48,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:14:48,820 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=2957a9c4bee7f52d38ac5e9cd8c8d4c1, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:48,820 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689167688820"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167688820"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167688820"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167688820"}]},"ts":"1689167688820"} 2023-07-12 13:14:48,823 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-12 13:14:48,823 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 2957a9c4bee7f52d38ac5e9cd8c8d4c1, server=jenkins-hbase17.apache.org,41721,1689167613545 in 184 msec 2023-07-12 13:14:48,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-07-12 13:14:48,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2957a9c4bee7f52d38ac5e9cd8c8d4c1, REOPEN/MOVE in 508 msec 2023-07-12 13:14:48,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-07-12 13:14:48,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 511 msec 2023-07-12 13:14:48,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 929 msec 2023-07-12 13:14:48,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-07-12 13:14:48,829 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(278): alter status finished 2023-07-12 13:14:48,830 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-12 13:14:48,831 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-12 13:14:48,831 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-12 13:14:48,832 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:48,832 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168288832 2023-07-12 13:14:48,833 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-12 13:14:48,833 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-07-12 13:14:48,833 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-12 13:14:48,834 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x255f705d to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:14:48,837 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f1ee83e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:14:48,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:48,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:48,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:48,838 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:48,838 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:48,838 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:48,838 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:48,838 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-12 13:14:48,838 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-12 13:14:48,838 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:48,840 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-12 13:14:48,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-07-12 13:14:48,897 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=243 (was 254), OpenFileDescriptor=614 (was 622), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=239 (was 213) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=8379 (was 8016) - AvailableMemoryMB LEAK? - 2023-07-12 13:14:48,907 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=243, OpenFileDescriptor=614, MaxFileDescriptor=60000, SystemLoadAverage=239, ProcessCount=166, AvailableMemoryMB=8377 2023-07-12 13:14:48,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-12 13:14:48,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:48,912 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:14:48,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-07-12 13:14:48,913 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:14:48,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-12 13:14:48,914 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:14:48,914 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0 empty. 2023-07-12 13:14:48,915 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:14:48,915 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-07-12 13:14:49,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-12 13:14:49,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-12 13:14:49,327 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-07-12 13:14:49,328 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0bbe9e37b47558540911eb888d91fed0, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:14:49,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-12 13:14:49,734 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:49,734 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 0bbe9e37b47558540911eb888d91fed0, disabling compactions & flushes 2023-07-12 13:14:49,734 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:49,734 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:49,735 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. after waiting 0 ms 2023-07-12 13:14:49,735 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:49,735 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:49,735 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:14:49,737 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:14:49,738 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689167689738"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167689738"}]},"ts":"1689167689738"} 2023-07-12 13:14:49,740 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 13:14:49,741 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:14:49,741 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167689741"}]},"ts":"1689167689741"} 2023-07-12 13:14:49,742 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-07-12 13:14:49,744 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0bbe9e37b47558540911eb888d91fed0, ASSIGN}] 2023-07-12 13:14:49,746 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0bbe9e37b47558540911eb888d91fed0, ASSIGN 2023-07-12 13:14:49,748 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0bbe9e37b47558540911eb888d91fed0, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:14:49,898 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=0bbe9e37b47558540911eb888d91fed0, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:49,899 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689167689898"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167689898"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167689898"}]},"ts":"1689167689898"} 2023-07-12 13:14:49,900 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 0bbe9e37b47558540911eb888d91fed0, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:14:50,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-12 13:14:50,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:50,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0bbe9e37b47558540911eb888d91fed0, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:14:50,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:14:50,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:14:50,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:14:50,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:14:50,057 INFO [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:14:50,059 DEBUG [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1 2023-07-12 13:14:50,059 DEBUG [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1 2023-07-12 13:14:50,059 INFO [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bbe9e37b47558540911eb888d91fed0 columnFamilyName family1 2023-07-12 13:14:50,061 INFO [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] regionserver.HStore(310): Store=0bbe9e37b47558540911eb888d91fed0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:14:50,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:14:50,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:14:50,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:14:50,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:14:50,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0bbe9e37b47558540911eb888d91fed0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65969561, jitterRate=-0.016976937651634216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:14:50,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:14:50,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0., pid=57, masterSystemTime=1689167690052 2023-07-12 13:14:50,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:50,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:50,069 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=0bbe9e37b47558540911eb888d91fed0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:50,069 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689167690069"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167690069"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167690069"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167690069"}]},"ts":"1689167690069"} 2023-07-12 13:14:50,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-07-12 13:14:50,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 0bbe9e37b47558540911eb888d91fed0, server=jenkins-hbase17.apache.org,41721,1689167613545 in 171 msec 2023-07-12 13:14:50,073 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-07-12 13:14:50,074 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0bbe9e37b47558540911eb888d91fed0, ASSIGN in 328 msec 2023-07-12 13:14:50,074 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:14:50,074 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167690074"}]},"ts":"1689167690074"} 2023-07-12 13:14:50,075 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-07-12 13:14:50,077 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:14:50,078 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1670 sec 2023-07-12 13:14:51,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-12 13:14:51,020 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-07-12 13:14:51,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:51,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,049 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:51,049 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:51,049 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-12 13:14:51,049 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-12 13:14:51,049 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,050 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,050 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:51,050 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:51,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:51,051 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,051 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,051 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,051 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,051 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-12 13:14:51,052 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:51,052 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-12 13:14:51,052 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:51,052 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:51,052 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:51,052 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. started... 2023-07-12 13:14:51,053 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0bbe9e37b47558540911eb888d91fed0 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-12 13:14:51,468 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130663898e974034b38937de86cf6fe7f41 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130663898e974034b38937de86cf6fe7f41 2023-07-12 13:14:51,872 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/86f704c2585347f88ea12f0f18782000 2023-07-12 13:14:51,881 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/86f704c2585347f88ea12f0f18782000 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/86f704c2585347f88ea12f0f18782000 2023-07-12 13:14:51,886 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/86f704c2585347f88ea12f0f18782000, entries=1000, sequenceid=5, filesize=190.5 K 2023-07-12 13:14:51,887 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0bbe9e37b47558540911eb888d91fed0 in 834ms, sequenceid=5, compaction requested=false 2023-07-12 13:14:51,887 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:51,887 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:14:51,887 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:51,888 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:51,888 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:51,888 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,888 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-12 13:14:51,888 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-12 13:14:51,889 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,889 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:51,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:51,889 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,889 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:51,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:51,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:51,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-12 13:14:51,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e849192[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:51,890 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-12 13:14:51,890 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,891 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,891 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-12 13:14:51,891 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-12 13:14:51,891 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,891 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:51,891 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:51,892 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,892 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-12 13:14:51,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:51,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:51,892 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:51,892 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-12 13:14:51,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:51,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:51,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:51,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:51,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-12 13:14:51,894 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-12 13:14:51,894 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:51,894 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:51,894 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,894 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:51,895 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,895 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:51,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:51,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,895 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:51,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:51,896 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:51,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:51,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:51,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,896 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:51,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,899 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:51,899 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,899 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,899 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:51,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:51,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:51,899 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:51,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:51,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:51,899 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,899 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:51,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-12 13:14:51,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:51,899 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:51,899 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,899 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:51,899 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:51,899 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:52,000 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:52,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:52,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:52,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:52,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,006 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:52,006 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:52,006 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-12 13:14:52,006 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-12 13:14:52,006 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,006 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,007 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,007 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:52,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:52,008 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,008 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,008 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,008 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-12 13:14:52,008 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,009 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-12 13:14:52,009 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:52,009 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-12 13:14:52,009 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:52,009 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:52,009 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:52,009 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. started... 2023-07-12 13:14:52,009 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0bbe9e37b47558540911eb888d91fed0 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-12 13:14:52,133 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 13:14:52,420 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280059a76cd70c4818b7a8f4de388344a1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511280059a76cd70c4818b7a8f4de388344a1 2023-07-12 13:14:52,781 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-12 13:14:52,826 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/c7cc322df46d40c4a3f96419c0beadfc 2023-07-12 13:14:52,835 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/c7cc322df46d40c4a3f96419c0beadfc as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/c7cc322df46d40c4a3f96419c0beadfc 2023-07-12 13:14:52,843 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/c7cc322df46d40c4a3f96419c0beadfc, entries=1, sequenceid=9, filesize=5.0 K 2023-07-12 13:14:52,844 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0bbe9e37b47558540911eb888d91fed0 in 835ms, sequenceid=9, compaction requested=false 2023-07-12 13:14:52,844 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:14:52,845 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:52,845 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:52,845 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:52,845 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,845 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-12 13:14:52,845 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-12 13:14:52,847 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,847 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:52,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:52,847 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,847 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:52,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:52,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:52,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:52,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-12 13:14:52,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f612726[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:52,850 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-12 13:14:52,851 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,851 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,852 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-12 13:14:52,852 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-12 13:14:52,852 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:52,852 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,852 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:52,854 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-12 13:14:52,854 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,854 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:52,854 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-12 13:14:52,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:52,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:52,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:52,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-12 13:14:52,859 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-12 13:14:52,859 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:52,859 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:52,859 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,859 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:52,861 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,861 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:52,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,862 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:52,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:52,862 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:52,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,865 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:52,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,867 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,868 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,868 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:52,868 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:52,868 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:52,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:52,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:52,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:52,868 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:52,868 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,868 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,868 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,868 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:52,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:52,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:52,868 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,869 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:52,969 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:52,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:52,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:52,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:52,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,983 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:52,983 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:52,983 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-12 13:14:52,983 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-12 13:14:52,984 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,984 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,986 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,986 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:52,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:52,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:52,986 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:52,987 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:52,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:52,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,989 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,989 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-12 13:14:52,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:52,990 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-12 13:14:52,990 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:52,990 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-12 13:14:52,990 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:52,990 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:52,990 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:52,991 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. started... 2023-07-12 13:14:52,991 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0bbe9e37b47558540911eb888d91fed0 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:53,408 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120120fabcf44c3140db91ec340bbff4bcdc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120120fabcf44c3140db91ec340bbff4bcdc 2023-07-12 13:14:53,814 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/2d03b708f80a4a98942b0f94c5e1efe4 2023-07-12 13:14:53,819 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/2d03b708f80a4a98942b0f94c5e1efe4 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/2d03b708f80a4a98942b0f94c5e1efe4 2023-07-12 13:14:53,823 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/2d03b708f80a4a98942b0f94c5e1efe4, entries=1, sequenceid=13, filesize=5.0 K 2023-07-12 13:14:53,824 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0bbe9e37b47558540911eb888d91fed0 in 833ms, sequenceid=13, compaction requested=true 2023-07-12 13:14:53,824 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:14:53,824 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:53,824 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:53,824 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:53,824 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,824 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-12 13:14:53,824 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-12 13:14:53,825 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,825 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:53,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:53,826 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:53,826 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:53,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:53,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:53,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-12 13:14:53,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5aef7c14[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:53,827 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-12 13:14:53,827 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,828 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,828 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-12 13:14:53,828 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-12 13:14:53,828 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:53,828 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,828 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:53,829 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,829 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-12 13:14:53,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:53,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:53,829 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:53,829 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-12 13:14:53,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:53,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:53,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:53,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-12 13:14:53,831 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-12 13:14:53,831 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:53,831 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:53,831 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,831 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:53,831 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,831 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,832 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:53,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:53,832 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:53,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,833 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:53,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,834 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,834 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:53,834 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:53,834 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:53,834 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:53,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:53,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:53,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:53,834 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,834 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,834 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,834 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,835 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,835 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:53,835 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:53,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:53,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:53,935 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:53,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:53,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:53,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:53,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,948 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:53,948 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:53,949 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-12 13:14:53,949 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-12 13:14:53,950 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,950 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,951 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:53,952 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:53,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:53,952 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:53,952 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:53,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:53,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,953 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,953 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-12 13:14:53,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:53,953 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-12 13:14:53,953 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:53,953 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-12 13:14:53,953 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:53,953 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:53,953 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:53,953 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. started... 2023-07-12 13:14:53,953 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0bbe9e37b47558540911eb888d91fed0 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:54,374 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a3578e081f884c33b3ff0623c26b0af5 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205a3578e081f884c33b3ff0623c26b0af5 2023-07-12 13:14:54,783 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/f8a274f5bbb84340a36bbbbfde7e7d72 2023-07-12 13:14:54,790 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/f8a274f5bbb84340a36bbbbfde7e7d72 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/f8a274f5bbb84340a36bbbbfde7e7d72 2023-07-12 13:14:54,795 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/f8a274f5bbb84340a36bbbbfde7e7d72, entries=1, sequenceid=17, filesize=5.0 K 2023-07-12 13:14:54,795 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0bbe9e37b47558540911eb888d91fed0 in 842ms, sequenceid=17, compaction requested=true 2023-07-12 13:14:54,796 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:14:54,796 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:54,796 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:54,796 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:54,796 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,796 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-12 13:14:54,796 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-12 13:14:54,798 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,798 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:54,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:54,798 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,798 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:54,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:54,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:54,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:54,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-12 13:14:54,799 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-12 13:14:54,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e2437ef[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:54,799 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,800 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,800 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-12 13:14:54,800 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,800 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:54,800 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-12 13:14:54,800 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:54,801 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:54,801 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-12 13:14:54,801 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:54,801 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-12 13:14:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:54,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-12 13:14:54,803 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-12 13:14:54,803 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:54,803 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:54,803 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,803 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:54,804 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,804 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:54,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:54,804 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:54,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:54,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:54,805 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:54,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:54,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,806 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,807 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,808 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:54,808 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,808 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:54,808 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:54,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:54,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:54,808 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,808 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:54,808 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:54,808 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,808 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,808 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:54,808 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:54,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:54,908 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:54,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:54,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:54,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:54,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,923 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:54,923 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:54,923 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-12 13:14:54,923 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-12 13:14:54,924 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,924 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,925 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:54,926 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:54,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:54,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,927 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:54,927 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:54,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:54,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,928 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,929 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-12 13:14:54,929 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:54,929 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-12 13:14:54,929 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:54,929 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-12 13:14:54,929 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:54,929 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:54,929 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:54,930 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. started... 2023-07-12 13:14:54,930 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0bbe9e37b47558540911eb888d91fed0 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:54,949 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122805a375f0cb6d47099807318c92e215bb to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122805a375f0cb6d47099807318c92e215bb 2023-07-12 13:14:55,358 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/8b753ec35c7643ce99c865f9e3d363d5 2023-07-12 13:14:55,370 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/8b753ec35c7643ce99c865f9e3d363d5 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/8b753ec35c7643ce99c865f9e3d363d5 2023-07-12 13:14:55,375 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/8b753ec35c7643ce99c865f9e3d363d5, entries=1, sequenceid=21, filesize=5.0 K 2023-07-12 13:14:55,376 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0bbe9e37b47558540911eb888d91fed0 in 446ms, sequenceid=21, compaction requested=true 2023-07-12 13:14:55,376 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:14:55,377 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:55,377 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:55,377 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:55,377 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,377 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-12 13:14:55,377 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-12 13:14:55,378 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,378 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:55,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:55,378 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,378 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:55,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:55,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-12 13:14:55,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f635b8[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:55,379 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-12 13:14:55,380 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,380 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,380 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-12 13:14:55,380 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-12 13:14:55,380 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:55,380 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,380 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:55,381 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-12 13:14:55,381 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,381 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:55,381 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-12 13:14:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:55,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-12 13:14:55,383 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-12 13:14:55,383 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:55,383 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:55,383 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,383 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:55,384 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,384 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,384 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:55,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:55,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:55,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,385 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:55,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,386 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,387 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:55,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:55,387 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,387 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:55,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-12 13:14:55,387 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:55,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:55,387 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:55,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:55,387 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,388 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,388 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,388 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:55,388 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,388 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:55,388 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,488 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:55,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:55,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:55,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:55,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,494 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:55,494 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:55,494 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-12 13:14:55,494 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-12 13:14:55,495 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,495 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,496 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:55,496 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:55,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:55,496 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:55,496 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:55,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:55,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,497 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,497 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-12 13:14:55,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:55,497 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-12 13:14:55,497 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:55,497 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-12 13:14:55,497 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:55,497 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:55,497 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:55,497 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. started... 2023-07-12 13:14:55,497 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0bbe9e37b47558540911eb888d91fed0 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:55,912 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123182b09a2398db4ebd82de33a5e7043288 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123182b09a2398db4ebd82de33a5e7043288 2023-07-12 13:14:56,319 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/97f1bcde441b432f92dce526cfd5f67b 2023-07-12 13:14:56,325 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/97f1bcde441b432f92dce526cfd5f67b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/97f1bcde441b432f92dce526cfd5f67b 2023-07-12 13:14:56,330 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/97f1bcde441b432f92dce526cfd5f67b, entries=1, sequenceid=25, filesize=5.0 K 2023-07-12 13:14:56,331 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0bbe9e37b47558540911eb888d91fed0 in 834ms, sequenceid=25, compaction requested=true 2023-07-12 13:14:56,331 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:14:56,331 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:56,331 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:56,331 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:56,331 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,331 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-12 13:14:56,331 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-12 13:14:56,332 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,332 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:56,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:56,333 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,333 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:56,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:56,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:56,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:56,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-12 13:14:56,334 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-12 13:14:56,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2286a17[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:56,334 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,335 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,335 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-12 13:14:56,335 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-12 13:14:56,335 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,335 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:56,335 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:56,336 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-12 13:14:56,336 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,336 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:56,336 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-12 13:14:56,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:56,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:56,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-12 13:14:56,338 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-12 13:14:56,338 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:56,338 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:56,338 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,338 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:56,340 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,340 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,340 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:56,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:56,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:56,341 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:56,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,342 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:56,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,344 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,344 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:56,344 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,345 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:56,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-12 13:14:56,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:56,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:56,345 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:56,345 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:56,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:56,345 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,345 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:56,345 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,345 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:56,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:56,345 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:56,345 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,445 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:56,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:56,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:56,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:56,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,451 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:56,451 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:56,451 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-12 13:14:56,451 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-12 13:14:56,452 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,452 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,453 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,453 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:56,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:56,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:56,453 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,453 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:56,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:56,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,454 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,454 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-12 13:14:56,454 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,454 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-12 13:14:56,454 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:56,454 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-12 13:14:56,454 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:56,455 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:56,455 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:56,455 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. started... 2023-07-12 13:14:56,455 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0bbe9e37b47558540911eb888d91fed0 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:56,868 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010106daa5bcd02e4c32963c7b7d42e48686 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010106daa5bcd02e4c32963c7b7d42e48686 2023-07-12 13:14:56,876 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/27801be79f2b4c229ce3f95463e8861b 2023-07-12 13:14:56,881 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/27801be79f2b4c229ce3f95463e8861b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/27801be79f2b4c229ce3f95463e8861b 2023-07-12 13:14:56,886 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/27801be79f2b4c229ce3f95463e8861b, entries=1, sequenceid=29, filesize=5.0 K 2023-07-12 13:14:56,886 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0bbe9e37b47558540911eb888d91fed0 in 431ms, sequenceid=29, compaction requested=true 2023-07-12 13:14:56,886 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:14:56,886 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:56,887 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:56,887 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:56,887 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,887 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-12 13:14:56,887 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-12 13:14:56,888 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,888 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:56,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:56,888 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:56,888 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:56,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:56,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:56,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-12 13:14:56,889 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-12 13:14:56,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2306b99a[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:56,889 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,890 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,890 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-12 13:14:56,890 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-12 13:14:56,890 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:56,890 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,890 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:56,891 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-12 13:14:56,891 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,891 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:56,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:56,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:56,891 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-12 13:14:56,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:56,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:56,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:56,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:56,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-12 13:14:56,893 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-12 13:14:56,893 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:56,893 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:56,893 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,893 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:56,894 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,894 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:56,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:56,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,894 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:56,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:56,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:56,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:56,897 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:56,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,899 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,902 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,902 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:56,902 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:56,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:56,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:56,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:56,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:56,902 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:56,902 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,902 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,902 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:56,902 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,902 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:56,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-12 13:14:56,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:56,902 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:56,902 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:56,903 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,003 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:57,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:57,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:57,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:57,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,013 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:57,013 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:57,013 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-12 13:14:57,013 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-12 13:14:57,014 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,014 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,015 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:57,015 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:57,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:57,015 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,015 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:57,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:57,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,016 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,016 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-12 13:14:57,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,016 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-12 13:14:57,016 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:57,016 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-12 13:14:57,016 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:57,016 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:57,016 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:57,016 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. started... 2023-07-12 13:14:57,016 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0bbe9e37b47558540911eb888d91fed0 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:57,442 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010333839d2539674cbd97023f88267544f9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010333839d2539674cbd97023f88267544f9 2023-07-12 13:14:57,449 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/15b4430ed257418fbf68e5350279061a 2023-07-12 13:14:57,455 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/15b4430ed257418fbf68e5350279061a as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/15b4430ed257418fbf68e5350279061a 2023-07-12 13:14:57,460 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/15b4430ed257418fbf68e5350279061a, entries=1, sequenceid=33, filesize=5.0 K 2023-07-12 13:14:57,461 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0bbe9e37b47558540911eb888d91fed0 in 445ms, sequenceid=33, compaction requested=true 2023-07-12 13:14:57,461 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:14:57,461 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:57,461 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:57,461 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:57,461 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,461 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-12 13:14:57,461 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-12 13:14:57,462 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,462 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:57,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:57,462 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,462 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:57,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-12 13:14:57,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ce2695a[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:57,464 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-12 13:14:57,464 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,464 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,464 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-12 13:14:57,464 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-12 13:14:57,465 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:57,465 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,465 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:57,465 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,465 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-12 13:14:57,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:57,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:57,465 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:57,465 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-12 13:14:57,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:57,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:57,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:57,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:57,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-12 13:14:57,467 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-12 13:14:57,467 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:57,467 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:57,467 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,467 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:57,468 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,468 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,468 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:57,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:57,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:57,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:57,469 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:57,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:57,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:57,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,470 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:57,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:57,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:57,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:57,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:57,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:57,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-12 13:14:57,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,471 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:57,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:57,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,471 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,472 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,472 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:57,472 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:57,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:57,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:57,572 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:57,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:57,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:57,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:57,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,579 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:57,580 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:57,580 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-12 13:14:57,580 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-12 13:14:57,580 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,580 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,581 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,581 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:57,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:57,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:57,582 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:57,582 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:57,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:57,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,583 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,583 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-12 13:14:57,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:57,584 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-12 13:14:57,584 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:57,584 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-12 13:14:57,584 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:57,584 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:57,584 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:57,584 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. started... 2023-07-12 13:14:57,584 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0bbe9e37b47558540911eb888d91fed0 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:58,001 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ef60adbf9e334592a54fe95178f74110 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907ef60adbf9e334592a54fe95178f74110 2023-07-12 13:14:58,008 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/94644aa0de5f483b92724f181e57a3db 2023-07-12 13:14:58,013 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/94644aa0de5f483b92724f181e57a3db as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/94644aa0de5f483b92724f181e57a3db 2023-07-12 13:14:58,018 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/94644aa0de5f483b92724f181e57a3db, entries=1, sequenceid=37, filesize=5.0 K 2023-07-12 13:14:58,019 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0bbe9e37b47558540911eb888d91fed0 in 435ms, sequenceid=37, compaction requested=true 2023-07-12 13:14:58,019 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:14:58,019 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:58,019 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:58,019 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:58,019 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,019 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-12 13:14:58,019 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-12 13:14:58,020 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,020 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:58,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:58,020 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,020 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:58,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:58,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:58,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:58,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-12 13:14:58,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@698ccc8b[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:58,022 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-12 13:14:58,022 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,022 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,022 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-12 13:14:58,023 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-12 13:14:58,023 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:58,023 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,023 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:58,023 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-12 13:14:58,023 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,023 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:58,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:58,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:58,023 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-12 13:14:58,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:58,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:58,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:58,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:58,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-12 13:14:58,025 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-12 13:14:58,025 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:58,025 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:58,025 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,025 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:58,027 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,027 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,027 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:58,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:58,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:58,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:58,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:58,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:58,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,027 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,028 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:58,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,030 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:58,030 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:58,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:58,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:58,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:58,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:58,030 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:58,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:58,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:58,030 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:58,031 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:58,032 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,032 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,032 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,032 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,032 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,032 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,032 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,131 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:58,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:58,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:14:58,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-12 13:14:58,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,137 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:58,137 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:58,137 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-12 13:14:58,137 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-12 13:14:58,137 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,137 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,138 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,138 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:58,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:58,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:58,138 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,138 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:14:58,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:14:58,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,139 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,139 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-12 13:14:58,139 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,139 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-12 13:14:58,139 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:14:58,139 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-12 13:14:58,139 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:14:58,139 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:14:58,139 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:58,139 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. started... 2023-07-12 13:14:58,139 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0bbe9e37b47558540911eb888d91fed0 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:14:58,560 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120bba59a9651bb43918b4052da7a1605d4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120bba59a9651bb43918b4052da7a1605d4 2023-07-12 13:14:58,967 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/4f9e938cff8b42ee91e5f32bb20c0717 2023-07-12 13:14:58,974 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/4f9e938cff8b42ee91e5f32bb20c0717 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/4f9e938cff8b42ee91e5f32bb20c0717 2023-07-12 13:14:58,981 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/4f9e938cff8b42ee91e5f32bb20c0717, entries=1, sequenceid=41, filesize=5.0 K 2023-07-12 13:14:58,982 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0bbe9e37b47558540911eb888d91fed0 in 843ms, sequenceid=41, compaction requested=true 2023-07-12 13:14:58,982 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:14:58,982 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:58,982 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:14:58,982 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:14:58,982 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,982 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-12 13:14:58,982 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-12 13:14:58,984 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,984 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:58,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:58,985 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,985 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:14:58,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:58,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:58,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:58,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-12 13:14:58,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28b56b7f[Count = 0] remaining members to acquire global barrier 2023-07-12 13:14:58,987 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-12 13:14:58,987 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,988 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,989 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-12 13:14:58,989 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-12 13:14:58,989 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:14:58,989 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,989 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:14:58,990 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-12 13:14:58,990 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,990 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:58,990 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-12 13:14:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:58,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:58,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:58,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:14:58,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-12 13:14:58,992 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-12 13:14:58,992 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:14:58,992 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:14:58,992 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,992 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:14:58,993 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,993 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:14:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:14:58,993 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:58,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:14:58,993 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:58,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:58,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:14:58,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,994 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:14:58,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,995 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:14:58,996 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:14:58,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:14:58,996 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,996 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-12 13:14:58,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:14:58,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:14:58,996 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,996 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:14:58,996 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:14:58,996 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,996 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,996 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:58,996 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-12 13:14:58,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:14:58,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:14:58,996 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:14:59,096 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:14:59,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:14:59,101 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:14:59,103 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-12 13:14:59,104 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-12 13:14:59,105 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:14:59,105 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168299105 2023-07-12 13:14:59,105 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-12 13:14:59,107 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-07-12 13:14:59,107 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-12 13:14:59,107 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x2c3fa551 to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:14:59,111 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b48a392, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:14:59,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:14:59,556 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010369c17fa241e64e7e8d1ef6dba5585009 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010369c17fa241e64e7e8d1ef6dba5585009 2023-07-12 13:14:59,557 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-12 13:14:59,570 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:14:59,571 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:14:59,576 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:14:59,577 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:14:59,586 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ade0bf5e54424817baad7d1bd45d5fdd first=Optional[r3] last=Optional[r6] 2023-07-12 13:14:59,587 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ade0bf5e54424817baad7d1bd45d5fdd}] 2023-07-12 13:14:59,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ade0bf5e54424817baad7d1bd45d5fdd for inclusion in 0bbe9e37b47558540911eb888d91fed0/family1 2023-07-12 13:14:59,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-12 13:14:59,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:14:59,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:14:59,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ade0bf5e54424817baad7d1bd45d5fdd to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__98d6pcggb9ebusskiodrn886r01spli2bkrgp53q0h97s56p9fguntmsrpnu3nnu/family1/ade0bf5e54424817baad7d1bd45d5fdd 2023-07-12 13:14:59,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__98d6pcggb9ebusskiodrn886r01spli2bkrgp53q0h97s56p9fguntmsrpnu3nnu/family1/ade0bf5e54424817baad7d1bd45d5fdd as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/c641b8cd38474d45af57643a88789709_SeqId_44_ 2023-07-12 13:14:59,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__98d6pcggb9ebusskiodrn886r01spli2bkrgp53q0h97s56p9fguntmsrpnu3nnu/family1/ade0bf5e54424817baad7d1bd45d5fdd into 0bbe9e37b47558540911eb888d91fed0/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/c641b8cd38474d45af57643a88789709_SeqId_44_ - updating store file list. 2023-07-12 13:14:59,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/c641b8cd38474d45af57643a88789709_SeqId_44_ into 0bbe9e37b47558540911eb888d91fed0/family1 2023-07-12 13:14:59,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__98d6pcggb9ebusskiodrn886r01spli2bkrgp53q0h97s56p9fguntmsrpnu3nnu/family1/ade0bf5e54424817baad7d1bd45d5fdd into 0bbe9e37b47558540911eb888d91fed0/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/c641b8cd38474d45af57643a88789709_SeqId_44_) 2023-07-12 13:14:59,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__98d6pcggb9ebusskiodrn886r01spli2bkrgp53q0h97s56p9fguntmsrpnu3nnu/family1/ade0bf5e54424817baad7d1bd45d5fdd 2023-07-12 13:14:59,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-12 13:14:59,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-12 13:14:59,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(1912): 0bbe9e37b47558540911eb888d91fed0/family1 is initiating minor compaction 2023-07-12 13:14:59,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@72df66d4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:14:59,603 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 0bbe9e37b47558540911eb888d91fed0/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:14:59,603 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/c7cc322df46d40c4a3f96419c0beadfc, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/2d03b708f80a4a98942b0f94c5e1efe4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/f8a274f5bbb84340a36bbbbfde7e7d72, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/8b753ec35c7643ce99c865f9e3d363d5, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/97f1bcde441b432f92dce526cfd5f67b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/27801be79f2b4c229ce3f95463e8861b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/15b4430ed257418fbf68e5350279061a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/94644aa0de5f483b92724f181e57a3db, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/4f9e938cff8b42ee91e5f32bb20c0717, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/c641b8cd38474d45af57643a88789709_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp, totalSize=50.3 K 2023-07-12 13:14:59,603 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting c7cc322df46d40c4a3f96419c0beadfc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-12 13:14:59,603 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting 2d03b708f80a4a98942b0f94c5e1efe4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-12 13:14:59,604 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting f8a274f5bbb84340a36bbbbfde7e7d72, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-12 13:14:59,604 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting 8b753ec35c7643ce99c865f9e3d363d5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-12 13:14:59,604 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting 97f1bcde441b432f92dce526cfd5f67b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-12 13:14:59,604 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting 27801be79f2b4c229ce3f95463e8861b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-12 13:14:59,604 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting 15b4430ed257418fbf68e5350279061a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-12 13:14:59,604 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting 94644aa0de5f483b92724f181e57a3db, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-12 13:14:59,604 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting 4f9e938cff8b42ee91e5f32bb20c0717, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-12 13:14:59,604 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting c641b8cd38474d45af57643a88789709_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-12 13:14:59,605 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-12 13:14:59,605 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:14:59,607 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122805a375f0cb6d47099807318c92e215bb to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122805a375f0cb6d47099807318c92e215bb 2023-07-12 13:14:59,608 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123182b09a2398db4ebd82de33a5e7043288 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123182b09a2398db4ebd82de33a5e7043288 2023-07-12 13:14:59,609 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010106daa5bcd02e4c32963c7b7d42e48686 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010106daa5bcd02e4c32963c7b7d42e48686 2023-07-12 13:14:59,610 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010333839d2539674cbd97023f88267544f9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010333839d2539674cbd97023f88267544f9 2023-07-12 13:14:59,610 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-07-12 13:14:59,610 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-12 13:14:59,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:14:59,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:14:59,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:14:59,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:14:59,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:14:59,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:14:59,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:14:59,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:14:59,637 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] throttle.PressureAwareThroughputController(145): 0bbe9e37b47558540911eb888d91fed0#family1#compaction#73 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:00,455 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/166ae7c89b554cba83ba0944867e547d as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/166ae7c89b554cba83ba0944867e547d 2023-07-12 13:15:00,461 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120555a74378330e4466bbd01ab0dc737aff to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120555a74378330e4466bbd01ab0dc737aff 2023-07-12 13:15:00,462 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-12 13:15:00,463 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0bbe9e37b47558540911eb888d91fed0/family1 of 0bbe9e37b47558540911eb888d91fed0 into 166ae7c89b554cba83ba0944867e547d(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:15:00,463 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:15:00,463 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1689167699603; duration=0sec 2023-07-12 13:15:00,463 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:15:00,487 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/c7cc322df46d40c4a3f96419c0beadfc, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/2d03b708f80a4a98942b0f94c5e1efe4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/f8a274f5bbb84340a36bbbbfde7e7d72, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/8b753ec35c7643ce99c865f9e3d363d5, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/97f1bcde441b432f92dce526cfd5f67b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/27801be79f2b4c229ce3f95463e8861b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/15b4430ed257418fbf68e5350279061a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/94644aa0de5f483b92724f181e57a3db, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/4f9e938cff8b42ee91e5f32bb20c0717, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/c641b8cd38474d45af57643a88789709_SeqId_44_] to archive 2023-07-12 13:15:00,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:00,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/c7cc322df46d40c4a3f96419c0beadfc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/c7cc322df46d40c4a3f96419c0beadfc 2023-07-12 13:15:00,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/2d03b708f80a4a98942b0f94c5e1efe4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/2d03b708f80a4a98942b0f94c5e1efe4 2023-07-12 13:15:00,495 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/f8a274f5bbb84340a36bbbbfde7e7d72 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/f8a274f5bbb84340a36bbbbfde7e7d72 2023-07-12 13:15:00,496 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7e99a6190973416393d58b1602ca46ab first=Optional[r00] last=Optional[r2] 2023-07-12 13:15:00,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/8b753ec35c7643ce99c865f9e3d363d5 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/8b753ec35c7643ce99c865f9e3d363d5 2023-07-12 13:15:00,497 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7e99a6190973416393d58b1602ca46ab}] 2023-07-12 13:15:00,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/97f1bcde441b432f92dce526cfd5f67b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/97f1bcde441b432f92dce526cfd5f67b 2023-07-12 13:15:00,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7e99a6190973416393d58b1602ca46ab for inclusion in 0bbe9e37b47558540911eb888d91fed0/family1 2023-07-12 13:15:00,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/27801be79f2b4c229ce3f95463e8861b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/27801be79f2b4c229ce3f95463e8861b 2023-07-12 13:15:00,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/15b4430ed257418fbf68e5350279061a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/15b4430ed257418fbf68e5350279061a 2023-07-12 13:15:00,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-07-12 13:15:00,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/94644aa0de5f483b92724f181e57a3db to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/94644aa0de5f483b92724f181e57a3db 2023-07-12 13:15:00,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:15:00,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:15:00,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/4f9e938cff8b42ee91e5f32bb20c0717 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/4f9e938cff8b42ee91e5f32bb20c0717 2023-07-12 13:15:00,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7e99a6190973416393d58b1602ca46ab to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__irbmn079beoscol7ld78qgmmga21d37rt0jau5j6oahccncfv035ej2kbcc04991/family1/7e99a6190973416393d58b1602ca46ab 2023-07-12 13:15:00,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/c641b8cd38474d45af57643a88789709_SeqId_44_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/c641b8cd38474d45af57643a88789709_SeqId_44_ 2023-07-12 13:15:00,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__irbmn079beoscol7ld78qgmmga21d37rt0jau5j6oahccncfv035ej2kbcc04991/family1/7e99a6190973416393d58b1602ca46ab as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/1f62ae5c4b084f7f93a647b6437b80a0_SeqId_47_ 2023-07-12 13:15:00,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__irbmn079beoscol7ld78qgmmga21d37rt0jau5j6oahccncfv035ej2kbcc04991/family1/7e99a6190973416393d58b1602ca46ab into 0bbe9e37b47558540911eb888d91fed0/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/1f62ae5c4b084f7f93a647b6437b80a0_SeqId_47_ - updating store file list. 2023-07-12 13:15:00,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/1f62ae5c4b084f7f93a647b6437b80a0_SeqId_47_ into 0bbe9e37b47558540911eb888d91fed0/family1 2023-07-12 13:15:00,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__irbmn079beoscol7ld78qgmmga21d37rt0jau5j6oahccncfv035ej2kbcc04991/family1/7e99a6190973416393d58b1602ca46ab into 0bbe9e37b47558540911eb888d91fed0/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/1f62ae5c4b084f7f93a647b6437b80a0_SeqId_47_) 2023-07-12 13:15:00,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__irbmn079beoscol7ld78qgmmga21d37rt0jau5j6oahccncfv035ej2kbcc04991/family1/7e99a6190973416393d58b1602ca46ab 2023-07-12 13:15:00,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 13:15:00,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 13:15:00,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(1912): 0bbe9e37b47558540911eb888d91fed0/family1 is initiating minor compaction (all files) 2023-07-12 13:15:00,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4f9194dd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:15:00,513 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0bbe9e37b47558540911eb888d91fed0/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:00,513 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/86f704c2585347f88ea12f0f18782000, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/166ae7c89b554cba83ba0944867e547d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/1f62ae5c4b084f7f93a647b6437b80a0_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp, totalSize=388.1 K 2023-07-12 13:15:00,513 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 86f704c2585347f88ea12f0f18782000, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837060 2023-07-12 13:15:00,514 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 166ae7c89b554cba83ba0944867e547d, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237060 2023-07-12 13:15:00,514 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 1f62ae5c4b084f7f93a647b6437b80a0_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878837060 2023-07-12 13:15:00,514 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-12 13:15:00,515 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:00,516 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130663898e974034b38937de86cf6fe7f41 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130663898e974034b38937de86cf6fe7f41 2023-07-12 13:15:00,517 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120120fabcf44c3140db91ec340bbff4bcdc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120120fabcf44c3140db91ec340bbff4bcdc 2023-07-12 13:15:00,518 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205a3578e081f884c33b3ff0623c26b0af5 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205a3578e081f884c33b3ff0623c26b0af5 2023-07-12 13:15:00,518 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-07-12 13:15:00,518 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-12 13:15:00,519 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:00,519 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-12 13:15:00,519 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:15:00,519 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-12 13:15:00,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4170 sec 2023-07-12 13:15:00,528 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0bbe9e37b47558540911eb888d91fed0#family1#compaction#74 average throughput is 25.66 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:00,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$12(2454): Client=jenkins//136.243.18.41 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-12 13:15:00,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:15:00,601 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-07-12 13:15:00,602 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-07-12 13:15:00,602 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-07-12 13:15:00,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-07-12 13:15:00,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0bbe9e37b47558540911eb888d91fed0, REOPEN/MOVE}] 2023-07-12 13:15:00,608 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0bbe9e37b47558540911eb888d91fed0, REOPEN/MOVE 2023-07-12 13:15:00,609 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=0bbe9e37b47558540911eb888d91fed0, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:00,609 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689167700609"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167700609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167700609"}]},"ts":"1689167700609"} 2023-07-12 13:15:00,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 0bbe9e37b47558540911eb888d91fed0, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:00,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:00,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0bbe9e37b47558540911eb888d91fed0, disabling compactions & flushes 2023-07-12 13:15:00,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:01,758 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/.tmp/family1/847da6787b5642cfaf658e6fc8bd0485 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/847da6787b5642cfaf658e6fc8bd0485 2023-07-12 13:15:01,765 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0bbe9e37b47558540911eb888d91fed0/family1 of 0bbe9e37b47558540911eb888d91fed0 into 847da6787b5642cfaf658e6fc8bd0485(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:15:01,765 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:15:01,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:01,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:01,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. after waiting 0 ms 2023-07-12 13:15:01,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:01,766 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1689167700513; duration=1sec 2023-07-12 13:15:01,766 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:15:01,771 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/86f704c2585347f88ea12f0f18782000, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/166ae7c89b554cba83ba0944867e547d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/1f62ae5c4b084f7f93a647b6437b80a0_SeqId_47_] to archive 2023-07-12 13:15:01,772 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:01,775 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/86f704c2585347f88ea12f0f18782000 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/86f704c2585347f88ea12f0f18782000 2023-07-12 13:15:01,778 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/166ae7c89b554cba83ba0944867e547d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/166ae7c89b554cba83ba0944867e547d 2023-07-12 13:15:01,780 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/1f62ae5c4b084f7f93a647b6437b80a0_SeqId_47_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/1f62ae5c4b084f7f93a647b6437b80a0_SeqId_47_ 2023-07-12 13:15:01,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-07-12 13:15:01,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:01,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:15:01,786 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 0bbe9e37b47558540911eb888d91fed0 to self. 2023-07-12 13:15:01,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:01,787 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=0bbe9e37b47558540911eb888d91fed0, regionState=CLOSED 2023-07-12 13:15:01,787 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689167701787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167701787"}]},"ts":"1689167701787"} 2023-07-12 13:15:01,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-07-12 13:15:01,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 0bbe9e37b47558540911eb888d91fed0, server=jenkins-hbase17.apache.org,41721,1689167613545 in 1.1780 sec 2023-07-12 13:15:01,790 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0bbe9e37b47558540911eb888d91fed0, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=true 2023-07-12 13:15:01,940 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=0bbe9e37b47558540911eb888d91fed0, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:01,941 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689167701940"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167701940"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167701940"}]},"ts":"1689167701940"} 2023-07-12 13:15:01,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 0bbe9e37b47558540911eb888d91fed0, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:02,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:02,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0bbe9e37b47558540911eb888d91fed0, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:15:02,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:02,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:02,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:02,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:02,102 INFO [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:02,104 DEBUG [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1 2023-07-12 13:15:02,104 DEBUG [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1 2023-07-12 13:15:02,104 INFO [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bbe9e37b47558540911eb888d91fed0 columnFamilyName family1 2023-07-12 13:15:02,112 DEBUG [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/847da6787b5642cfaf658e6fc8bd0485 2023-07-12 13:15:02,112 INFO [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] regionserver.HStore(310): Store=0bbe9e37b47558540911eb888d91fed0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:02,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:02,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:02,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:02,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0bbe9e37b47558540911eb888d91fed0; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59212919, jitterRate=-0.11765874922275543}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:15:02,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:15:02,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0., pid=63, masterSystemTime=1689167702097 2023-07-12 13:15:02,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:02,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:02,119 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=0bbe9e37b47558540911eb888d91fed0, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:02,119 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689167702119"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167702119"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167702119"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167702119"}]},"ts":"1689167702119"} 2023-07-12 13:15:02,121 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-07-12 13:15:02,121 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 0bbe9e37b47558540911eb888d91fed0, server=jenkins-hbase17.apache.org,41721,1689167613545 in 177 msec 2023-07-12 13:15:02,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-07-12 13:15:02,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0bbe9e37b47558540911eb888d91fed0, REOPEN/MOVE in 1.5140 sec 2023-07-12 13:15:02,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-12 13:15:02,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5190 sec 2023-07-12 13:15:02,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5370 sec 2023-07-12 13:15:02,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-07-12 13:15:02,130 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(278): alter status finished 2023-07-12 13:15:02,131 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:15:02,132 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-12 13:15:02,133 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-12 13:15:02,133 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:15:02,133 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168302133 2023-07-12 13:15:02,134 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-12 13:15:02,135 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-07-12 13:15:02,135 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-12 13:15:02,135 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x6e6f458c to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:15:02,138 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4330c305, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:15:02,139 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:02,139 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:02,139 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:02,139 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:02,139 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:02,972 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ceeb08175ac74bd2bf472beb8cb55ae3 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128ceeb08175ac74bd2bf472beb8cb55ae3 2023-07-12 13:15:02,974 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-12 13:15:02,989 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:15:02,990 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:15:02,996 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:15:02,998 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:15:03,008 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d9702cec08c04a82868955f276407eb1 first=Optional[r05] last=Optional[r8] 2023-07-12 13:15:03,009 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d9702cec08c04a82868955f276407eb1}] 2023-07-12 13:15:03,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d9702cec08c04a82868955f276407eb1 for inclusion in 0bbe9e37b47558540911eb888d91fed0/family1 2023-07-12 13:15:03,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-07-12 13:15:03,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:15:03,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:15:03,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d9702cec08c04a82868955f276407eb1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__7ncrv0p4fln8r5tdbnb9gs2r9jqdken5kj82asb34dkqkr6abd2lqs5b81t5fddq/family1/d9702cec08c04a82868955f276407eb1 2023-07-12 13:15:03,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__7ncrv0p4fln8r5tdbnb9gs2r9jqdken5kj82asb34dkqkr6abd2lqs5b81t5fddq/family1/d9702cec08c04a82868955f276407eb1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/03b1ec6fce794b998a2bed88d677835e_SeqId_53_ 2023-07-12 13:15:03,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__7ncrv0p4fln8r5tdbnb9gs2r9jqdken5kj82asb34dkqkr6abd2lqs5b81t5fddq/family1/d9702cec08c04a82868955f276407eb1 into 0bbe9e37b47558540911eb888d91fed0/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/03b1ec6fce794b998a2bed88d677835e_SeqId_53_ - updating store file list. 2023-07-12 13:15:03,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/03b1ec6fce794b998a2bed88d677835e_SeqId_53_ into 0bbe9e37b47558540911eb888d91fed0/family1 2023-07-12 13:15:03,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__7ncrv0p4fln8r5tdbnb9gs2r9jqdken5kj82asb34dkqkr6abd2lqs5b81t5fddq/family1/d9702cec08c04a82868955f276407eb1 into 0bbe9e37b47558540911eb888d91fed0/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/03b1ec6fce794b998a2bed88d677835e_SeqId_53_) 2023-07-12 13:15:03,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__7ncrv0p4fln8r5tdbnb9gs2r9jqdken5kj82asb34dkqkr6abd2lqs5b81t5fddq/family1/d9702cec08c04a82868955f276407eb1 2023-07-12 13:15:03,028 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-12 13:15:03,029 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:03,031 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120bba59a9651bb43918b4052da7a1605d4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120bba59a9651bb43918b4052da7a1605d4 2023-07-12 13:15:03,032 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511280059a76cd70c4818b7a8f4de388344a1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511280059a76cd70c4818b7a8f4de388344a1 2023-07-12 13:15:03,032 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-07-12 13:15:03,032 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-12 13:15:03,032 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:03,032 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:03,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:03,033 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-12 13:15:03,033 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:15:03,034 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-12 13:15:03,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 903 msec 2023-07-12 13:15:03,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$12(2454): Client=jenkins//136.243.18.41 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-07-12 13:15:03,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:15:03,497 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-07-12 13:15:03,499 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-07-12 13:15:03,499 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-07-12 13:15:03,503 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-07-12 13:15:03,507 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0bbe9e37b47558540911eb888d91fed0, REOPEN/MOVE}] 2023-07-12 13:15:03,508 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0bbe9e37b47558540911eb888d91fed0, REOPEN/MOVE 2023-07-12 13:15:03,508 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0bbe9e37b47558540911eb888d91fed0, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:03,508 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689167703508"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167703508"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167703508"}]},"ts":"1689167703508"} 2023-07-12 13:15:03,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 0bbe9e37b47558540911eb888d91fed0, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:03,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:03,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0bbe9e37b47558540911eb888d91fed0, disabling compactions & flushes 2023-07-12 13:15:03,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:03,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:03,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. after waiting 0 ms 2023-07-12 13:15:03,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:03,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-07-12 13:15:03,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:03,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:15:03,677 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 0bbe9e37b47558540911eb888d91fed0 to self. 2023-07-12 13:15:03,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:03,680 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0bbe9e37b47558540911eb888d91fed0, regionState=CLOSED 2023-07-12 13:15:03,680 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689167703680"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167703680"}]},"ts":"1689167703680"} 2023-07-12 13:15:03,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-07-12 13:15:03,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 0bbe9e37b47558540911eb888d91fed0, server=jenkins-hbase17.apache.org,41721,1689167613545 in 172 msec 2023-07-12 13:15:03,684 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0bbe9e37b47558540911eb888d91fed0, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=true 2023-07-12 13:15:03,834 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0bbe9e37b47558540911eb888d91fed0, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:03,835 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689167703834"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167703834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167703834"}]},"ts":"1689167703834"} 2023-07-12 13:15:03,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 0bbe9e37b47558540911eb888d91fed0, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:03,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:03,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0bbe9e37b47558540911eb888d91fed0, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:15:03,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:03,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:03,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:03,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:03,996 INFO [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:03,998 DEBUG [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1 2023-07-12 13:15:03,998 DEBUG [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1 2023-07-12 13:15:03,998 INFO [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bbe9e37b47558540911eb888d91fed0 columnFamilyName family1 2023-07-12 13:15:04,008 DEBUG [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/03b1ec6fce794b998a2bed88d677835e_SeqId_53_ 2023-07-12 13:15:04,013 DEBUG [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/family1/847da6787b5642cfaf658e6fc8bd0485 2023-07-12 13:15:04,013 INFO [StoreOpener-0bbe9e37b47558540911eb888d91fed0-1] regionserver.HStore(310): Store=0bbe9e37b47558540911eb888d91fed0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:04,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:04,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:04,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:15:04,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0bbe9e37b47558540911eb888d91fed0; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73049368, jitterRate=0.08852040767669678}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:15:04,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:15:04,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0., pid=69, masterSystemTime=1689167703990 2023-07-12 13:15:04,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:04,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:15:04,023 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0bbe9e37b47558540911eb888d91fed0, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:04,023 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689167704023"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167704023"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167704023"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167704023"}]},"ts":"1689167704023"} 2023-07-12 13:15:04,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-12 13:15:04,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 0bbe9e37b47558540911eb888d91fed0, server=jenkins-hbase17.apache.org,41721,1689167613545 in 187 msec 2023-07-12 13:15:04,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-12 13:15:04,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0bbe9e37b47558540911eb888d91fed0, REOPEN/MOVE in 519 msec 2023-07-12 13:15:04,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-07-12 13:15:04,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 525 msec 2023-07-12 13:15:04,031 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 944 msec 2023-07-12 13:15:04,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-07-12 13:15:04,033 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(278): alter status finished 2023-07-12 13:15:04,033 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-12 13:15:04,034 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-12 13:15:04,035 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-12 13:15:04,035 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168304035 2023-07-12 13:15:04,035 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:15:04,036 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-12 13:15:04,036 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-07-12 13:15:04,036 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-12 13:15:04,037 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x53f0e06d to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:15:04,041 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20fcc5bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:15:04,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:04,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:04,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:04,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:04,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:04,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:04,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:04,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-12 13:15:04,041 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-12 13:15:04,041 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:15:04,042 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-12 13:15:04,043 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 8 msec 2023-07-12 13:15:04,089 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=251 (was 243) - Thread LEAK? -, OpenFileDescriptor=644 (was 614) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=224 (was 239), ProcessCount=166 (was 166), AvailableMemoryMB=7948 (was 8377) 2023-07-12 13:15:04,100 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=251, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=224, ProcessCount=166, AvailableMemoryMB=7948 2023-07-12 13:15:04,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 13:15:04,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-07-12 13:15:04,105 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:15:04,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-07-12 13:15:04,106 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:15:04,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 13:15:04,107 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c 2023-07-12 13:15:04,108 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c empty. 2023-07-12 13:15:04,108 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c 2023-07-12 13:15:04,108 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-07-12 13:15:04,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 13:15:04,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 13:15:04,515 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-07-12 13:15:04,517 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => fc2acfb4db3a35f640bf380852a7ef6c, NAME => 'testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:15:04,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 13:15:04,924 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:04,924 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing fc2acfb4db3a35f640bf380852a7ef6c, disabling compactions & flushes 2023-07-12 13:15:04,924 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. 2023-07-12 13:15:04,924 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. 2023-07-12 13:15:04,925 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. after waiting 0 ms 2023-07-12 13:15:04,925 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. 2023-07-12 13:15:04,925 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. 2023-07-12 13:15:04,925 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for fc2acfb4db3a35f640bf380852a7ef6c: 2023-07-12 13:15:04,931 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:15:04,933 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689167704932"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167704932"}]},"ts":"1689167704932"} 2023-07-12 13:15:04,934 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 13:15:04,935 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:15:04,935 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167704935"}]},"ts":"1689167704935"} 2023-07-12 13:15:04,936 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-07-12 13:15:04,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=fc2acfb4db3a35f640bf380852a7ef6c, ASSIGN}] 2023-07-12 13:15:04,941 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=fc2acfb4db3a35f640bf380852a7ef6c, ASSIGN 2023-07-12 13:15:04,942 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=fc2acfb4db3a35f640bf380852a7ef6c, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:15:05,094 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=fc2acfb4db3a35f640bf380852a7ef6c, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:05,095 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689167705094"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167705094"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167705094"}]},"ts":"1689167705094"} 2023-07-12 13:15:05,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure fc2acfb4db3a35f640bf380852a7ef6c, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:05,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 13:15:05,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. 2023-07-12 13:15:05,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fc2acfb4db3a35f640bf380852a7ef6c, NAME => 'testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:15:05,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-07-12 13:15:05,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-07-12 13:15:05,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction fc2acfb4db3a35f640bf380852a7ef6c 2023-07-12 13:15:05,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:05,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for fc2acfb4db3a35f640bf380852a7ef6c 2023-07-12 13:15:05,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for fc2acfb4db3a35f640bf380852a7ef6c 2023-07-12 13:15:05,263 INFO [StoreOpener-fc2acfb4db3a35f640bf380852a7ef6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fc2acfb4db3a35f640bf380852a7ef6c 2023-07-12 13:15:05,265 DEBUG [StoreOpener-fc2acfb4db3a35f640bf380852a7ef6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1 2023-07-12 13:15:05,265 DEBUG [StoreOpener-fc2acfb4db3a35f640bf380852a7ef6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1 2023-07-12 13:15:05,266 INFO [StoreOpener-fc2acfb4db3a35f640bf380852a7ef6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc2acfb4db3a35f640bf380852a7ef6c columnFamilyName f1 2023-07-12 13:15:05,268 INFO [StoreOpener-fc2acfb4db3a35f640bf380852a7ef6c-1] regionserver.HStore(310): Store=fc2acfb4db3a35f640bf380852a7ef6c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:05,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c 2023-07-12 13:15:05,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c 2023-07-12 13:15:05,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for fc2acfb4db3a35f640bf380852a7ef6c 2023-07-12 13:15:05,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:15:05,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened fc2acfb4db3a35f640bf380852a7ef6c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62568162, jitterRate=-0.06766173243522644}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:15:05,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for fc2acfb4db3a35f640bf380852a7ef6c: 2023-07-12 13:15:05,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c., pid=73, masterSystemTime=1689167705252 2023-07-12 13:15:05,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. 2023-07-12 13:15:05,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. 2023-07-12 13:15:05,280 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=fc2acfb4db3a35f640bf380852a7ef6c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:05,280 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689167705280"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167705280"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167705280"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167705280"}]},"ts":"1689167705280"} 2023-07-12 13:15:05,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-07-12 13:15:05,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure fc2acfb4db3a35f640bf380852a7ef6c, server=jenkins-hbase17.apache.org,41721,1689167613545 in 183 msec 2023-07-12 13:15:05,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-12 13:15:05,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=fc2acfb4db3a35f640bf380852a7ef6c, ASSIGN in 344 msec 2023-07-12 13:15:05,287 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:15:05,287 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167705287"}]},"ts":"1689167705287"} 2023-07-12 13:15:05,289 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-07-12 13:15:05,291 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:15:05,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1880 sec 2023-07-12 13:15:06,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 13:15:06,214 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-07-12 13:15:06,214 DEBUG [Listener at localhost.localdomain/44505] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-07-12 13:15:06,217 INFO [Listener at localhost.localdomain/44505] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 13:15:06,221 INFO [Listener at localhost.localdomain/44505] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-07-12 13:15:06,222 INFO [Listener at localhost.localdomain/44505] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 13:15:06,222 INFO [Listener at localhost.localdomain/44505] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-07-12 13:15:06,226 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2745): Flushing fc2acfb4db3a35f640bf380852a7ef6c 1/1 column families, dataSize=37 B heapSize=368 B 2023-07-12 13:15:06,646 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712d7a7fb3b7ba84e7ba8d73703faecd079 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230712d7a7fb3b7ba84e7ba8d73703faecd079 2023-07-12 13:15:07,052 INFO [Listener at localhost.localdomain/44505] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/.tmp/f1/42d52f7791474ea9a09dfc7d12c4b316 2023-07-12 13:15:07,064 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/.tmp/f1/42d52f7791474ea9a09dfc7d12c4b316 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316 2023-07-12 13:15:07,070 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316, entries=1, sequenceid=5, filesize=4.9 K 2023-07-12 13:15:07,071 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for fc2acfb4db3a35f640bf380852a7ef6c in 845ms, sequenceid=5, compaction requested=false 2023-07-12 13:15:07,071 DEBUG [Listener at localhost.localdomain/44505] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-07-12 13:15:07,072 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2446): Flush status journal for fc2acfb4db3a35f640bf380852a7ef6c: 2023-07-12 13:15:07,074 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2745): Flushing fc2acfb4db3a35f640bf380852a7ef6c 1/1 column families, dataSize=37 B heapSize=368 B 2023-07-12 13:15:07,093 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307128982cc1917494db6a5be2cbac2cde4e9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202307128982cc1917494db6a5be2cbac2cde4e9 2023-07-12 13:15:07,320 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 13:15:07,507 INFO [Listener at localhost.localdomain/44505] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/.tmp/f1/63e1b436ef5d4f6295caf1b41937256d 2023-07-12 13:15:07,514 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/.tmp/f1/63e1b436ef5d4f6295caf1b41937256d as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d 2023-07-12 13:15:07,519 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d, entries=1, sequenceid=9, filesize=4.9 K 2023-07-12 13:15:07,520 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for fc2acfb4db3a35f640bf380852a7ef6c in 446ms, sequenceid=9, compaction requested=false 2023-07-12 13:15:07,520 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2446): Flush status journal for fc2acfb4db3a35f640bf380852a7ef6c: 2023-07-12 13:15:07,521 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-07-12 13:15:07,522 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-07-12 13:15:07,523 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-07-12 13:15:07,524 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:15:07,524 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168307524 2023-07-12 13:15:07,524 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-12 13:15:07,525 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-07-12 13:15:07,525 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-07-12 13:15:07,525 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x5fc8c75e to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:15:07,545 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@195f1001, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:15:07,545 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230712 for table='testGetAfterCompaction' and column='f1' 2023-07-12 13:15:07,573 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,573 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,624 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,625 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,676 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,676 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,728 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,728 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,780 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,780 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,832 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,832 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,883 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,884 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,935 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,935 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,985 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:07,985 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,036 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,037 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,088 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,088 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,139 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,139 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,191 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,191 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,243 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,243 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,295 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,295 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,347 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,347 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,391 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712f3acc21e2654438ba216c93441251a1e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230712f3acc21e2654438ba216c93441251a1e 2023-07-12 13:15:08,392 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230712 table='testGetAfterCompaction' column='f1' 2023-07-12 13:15:08,398 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,398 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,407 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:15:08,407 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:15:08,416 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:15:08,417 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44166, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:15:08,427 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230712/f1/ae2c970037004e9f9d204a19b218a0bc first=Optional[r1] last=Optional[r2] 2023-07-12 13:15:08,428 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{f1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230712/f1/ae2c970037004e9f9d204a19b218a0bc}] 2023-07-12 13:15:08,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230712/f1/ae2c970037004e9f9d204a19b218a0bc for inclusion in fc2acfb4db3a35f640bf380852a7ef6c/f1 2023-07-12 13:15:08,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-07-12 13:15:08,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:15:08,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for fc2acfb4db3a35f640bf380852a7ef6c: 2023-07-12 13:15:08,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230712/f1/ae2c970037004e9f9d204a19b218a0bc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testGetAfterCompaction__7j0g6oetorc5dqbthd54ahknh642gsjsvqg73on1j46qbd5597123p3olnloe16n/f1/ae2c970037004e9f9d204a19b218a0bc 2023-07-12 13:15:08,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testGetAfterCompaction__7j0g6oetorc5dqbthd54ahknh642gsjsvqg73on1j46qbd5597123p3olnloe16n/f1/ae2c970037004e9f9d204a19b218a0bc as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_ 2023-07-12 13:15:08,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testGetAfterCompaction__7j0g6oetorc5dqbthd54ahknh642gsjsvqg73on1j46qbd5597123p3olnloe16n/f1/ae2c970037004e9f9d204a19b218a0bc into fc2acfb4db3a35f640bf380852a7ef6c/f1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_ - updating store file list. 2023-07-12 13:15:08,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_ into fc2acfb4db3a35f640bf380852a7ef6c/f1 2023-07-12 13:15:08,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testGetAfterCompaction__7j0g6oetorc5dqbthd54ahknh642gsjsvqg73on1j46qbd5597123p3olnloe16n/f1/ae2c970037004e9f9d204a19b218a0bc into fc2acfb4db3a35f640bf380852a7ef6c/f1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_) 2023-07-12 13:15:08,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testGetAfterCompaction__7j0g6oetorc5dqbthd54ahknh642gsjsvqg73on1j46qbd5597123p3olnloe16n/f1/ae2c970037004e9f9d204a19b218a0bc 2023-07-12 13:15:08,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(1912): fc2acfb4db3a35f640bf380852a7ef6c/f1 is initiating minor compaction 2023-07-12 13:15:08,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7cd19bf4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:15:08,444 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fc2acfb4db3a35f640bf380852a7ef6c/f1 in testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. 2023-07-12 13:15:08,445 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/.tmp, totalSize=10.0 K 2023-07-12 13:15:08,445 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 63e1b436ef5d4f6295caf1b41937256d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-12 13:15:08,445 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting f2396f912c8648dc9e78281ba9897a36_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-12 13:15:08,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230712 table='testGetAfterCompaction' column='f1' 2023-07-12 13:15:08,447 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:08,448 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,448 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,449 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:08,449 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202307128982cc1917494db6a5be2cbac2cde4e9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202307128982cc1917494db6a5be2cbac2cde4e9 2023-07-12 13:15:08,450 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230712d7a7fb3b7ba84e7ba8d73703faecd079 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230712d7a7fb3b7ba84e7ba8d73703faecd079 2023-07-12 13:15:08,450 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-07-12 13:15:08,450 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230712' 2023-07-12 13:15:08,450 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230712 for table='testGetAfterCompaction' and column='f1' 2023-07-12 13:15:08,450 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-07-12 13:15:08,451 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:15:08,452 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-07-12 13:15:08,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 930 msec 2023-07-12 13:15:08,454 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): fc2acfb4db3a35f640bf380852a7ef6c#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:08,454 DEBUG [Listener at localhost.localdomain/44505] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 13:15:08,462 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 13:15:08,462 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41721] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. 2023-07-12 13:15:08,463 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-07-12 13:15:08,463 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-07-12 13:15:08,463 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41721] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-07-12 13:15:08,464 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41721] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. because compaction request was cancelled 2023-07-12 13:15:08,515 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,516 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,516 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:08,566 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,567 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,567 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:08,618 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,618 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,618 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:08,669 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,669 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,669 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:08,720 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,720 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,720 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:08,771 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,771 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,771 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:08,822 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,823 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,823 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:08,873 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,874 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,874 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:08,924 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,924 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,925 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:08,975 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,975 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:08,976 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:09,026 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,026 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,026 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:09,077 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,078 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,078 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:09,128 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,129 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,129 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:09,179 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,179 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,180 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:09,230 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,230 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,230 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:09,274 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/.tmp/f1/f83fd36c22574b7ea413686c9b66eb1b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f83fd36c22574b7ea413686c9b66eb1b 2023-07-12 13:15:09,279 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in fc2acfb4db3a35f640bf380852a7ef6c/f1 of fc2acfb4db3a35f640bf380852a7ef6c into f83fd36c22574b7ea413686c9b66eb1b(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:15:09,279 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fc2acfb4db3a35f640bf380852a7ef6c: 2023-07-12 13:15:09,280 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1689167708444; duration=0sec 2023-07-12 13:15:09,280 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:15:09,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_] to archive 2023-07-12 13:15:09,281 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:09,281 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707507; access_time=1689167707076; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,281 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689167708377; access_time=1689167707560; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-12 13:15:09,282 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f83fd36c22574b7ea413686c9b66eb1b; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1689167709269; access_time=1689167708450; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/63e1b436ef5d4f6295caf1b41937256d 2023-07-12 13:15:09,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f2396f912c8648dc9e78281ba9897a36_SeqId_12_ 2023-07-12 13:15:09,332 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689167707052; access_time=1689167706228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,332 INFO [Listener at localhost.localdomain/44505] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f83fd36c22574b7ea413686c9b66eb1b; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1689167709269; access_time=1689167708450; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-12 13:15:09,450 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-07-12 13:15:09,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testGetAfterCompaction 2023-07-12 13:15:09,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-07-12 13:15:09,462 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167709462"}]},"ts":"1689167709462"} 2023-07-12 13:15:09,463 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-07-12 13:15:09,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-07-12 13:15:09,465 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-07-12 13:15:09,467 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=fc2acfb4db3a35f640bf380852a7ef6c, UNASSIGN}] 2023-07-12 13:15:09,468 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=fc2acfb4db3a35f640bf380852a7ef6c, UNASSIGN 2023-07-12 13:15:09,469 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=fc2acfb4db3a35f640bf380852a7ef6c, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:09,469 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689167709469"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167709469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167709469"}]},"ts":"1689167709469"} 2023-07-12 13:15:09,470 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure fc2acfb4db3a35f640bf380852a7ef6c, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:09,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-07-12 13:15:09,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close fc2acfb4db3a35f640bf380852a7ef6c 2023-07-12 13:15:09,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing fc2acfb4db3a35f640bf380852a7ef6c, disabling compactions & flushes 2023-07-12 13:15:09,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. 2023-07-12 13:15:09,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. 2023-07-12 13:15:09,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. after waiting 0 ms 2023-07-12 13:15:09,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. 2023-07-12 13:15:09,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-07-12 13:15:09,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-07-12 13:15:09,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c. 2023-07-12 13:15:09,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for fc2acfb4db3a35f640bf380852a7ef6c: 2023-07-12 13:15:09,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed fc2acfb4db3a35f640bf380852a7ef6c 2023-07-12 13:15:09,630 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=fc2acfb4db3a35f640bf380852a7ef6c, regionState=CLOSED 2023-07-12 13:15:09,630 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689167709630"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167709630"}]},"ts":"1689167709630"} 2023-07-12 13:15:09,632 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-12 13:15:09,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure fc2acfb4db3a35f640bf380852a7ef6c, server=jenkins-hbase17.apache.org,41721,1689167613545 in 161 msec 2023-07-12 13:15:09,634 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-07-12 13:15:09,634 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=fc2acfb4db3a35f640bf380852a7ef6c, UNASSIGN in 166 msec 2023-07-12 13:15:09,635 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167709635"}]},"ts":"1689167709635"} 2023-07-12 13:15:09,636 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-07-12 13:15:09,637 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-07-12 13:15:09,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 182 msec 2023-07-12 13:15:09,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-07-12 13:15:09,766 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-07-12 13:15:09,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testGetAfterCompaction 2023-07-12 13:15:09,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-07-12 13:15:09,776 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-12 13:15:09,777 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-12 13:15:09,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-07-12 13:15:09,780 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c 2023-07-12 13:15:09,782 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1, FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/recovered.edits] 2023-07-12 13:15:09,787 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/42d52f7791474ea9a09dfc7d12c4b316 2023-07-12 13:15:09,788 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f83fd36c22574b7ea413686c9b66eb1b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/f1/f83fd36c22574b7ea413686c9b66eb1b 2023-07-12 13:15:09,790 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/recovered.edits/15.seqid to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c/recovered.edits/15.seqid 2023-07-12 13:15:09,791 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testGetAfterCompaction/fc2acfb4db3a35f640bf380852a7ef6c 2023-07-12 13:15:09,791 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-07-12 13:15:09,791 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-07-12 13:15:09,792 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-07-12 13:15:09,794 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230712f3acc21e2654438ba216c93441251a1e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230712f3acc21e2654438ba216c93441251a1e 2023-07-12 13:15:09,795 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-07-12 13:15:09,797 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-12 13:15:09,826 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-07-12 13:15:09,828 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-07-12 13:15:09,829 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-12 13:15:09,829 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-07-12 13:15:09,829 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689167709829"}]},"ts":"9223372036854775807"} 2023-07-12 13:15:09,831 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-12 13:15:09,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fc2acfb4db3a35f640bf380852a7ef6c, NAME => 'testGetAfterCompaction,,1689167704103.fc2acfb4db3a35f640bf380852a7ef6c.', STARTKEY => '', ENDKEY => ''}] 2023-07-12 13:15:09,831 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-07-12 13:15:09,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689167709831"}]},"ts":"9223372036854775807"} 2023-07-12 13:15:09,841 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-07-12 13:15:09,843 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-12 13:15:09,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 73 msec 2023-07-12 13:15:09,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-07-12 13:15:09,880 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-07-12 13:15:09,897 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=255 (was 251) - Thread LEAK? -, OpenFileDescriptor=646 (was 644) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 224), ProcessCount=166 (was 166), AvailableMemoryMB=7921 (was 7948) 2023-07-12 13:15:09,912 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=255, OpenFileDescriptor=646, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=166, AvailableMemoryMB=7919 2023-07-12 13:15:09,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 13:15:09,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-07-12 13:15:09,917 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:15:09,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-07-12 13:15:09,917 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:15:09,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-12 13:15:09,920 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:09,920 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591 2023-07-12 13:15:09,920 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:09,920 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637 empty. 2023-07-12 13:15:09,920 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8 empty. 2023-07-12 13:15:09,921 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591 empty. 2023-07-12 13:15:09,921 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:09,921 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591 2023-07-12 13:15:09,921 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:09,921 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-07-12 13:15:10,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-12 13:15:10,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-12 13:15:10,335 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-07-12 13:15:10,336 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 684e9c34724c737ee5eb5d368452e637, NAME => 'testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:15:10,337 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 9c3dd1c27a1a45c43f96b95fb3aa34b8, NAME => 'testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:15:10,337 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => c9662635c9aef48a82b6818321244591, NAME => 'testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:15:10,352 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:10,352 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 9c3dd1c27a1a45c43f96b95fb3aa34b8, disabling compactions & flushes 2023-07-12 13:15:10,352 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:10,352 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:10,352 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. after waiting 0 ms 2023-07-12 13:15:10,352 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:10,352 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:10,352 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:10,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-12 13:15:10,753 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:10,753 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:10,754 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing c9662635c9aef48a82b6818321244591, disabling compactions & flushes 2023-07-12 13:15:10,754 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 684e9c34724c737ee5eb5d368452e637, disabling compactions & flushes 2023-07-12 13:15:10,754 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:10,754 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:10,754 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:10,754 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:10,755 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. after waiting 0 ms 2023-07-12 13:15:10,755 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:10,755 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. after waiting 0 ms 2023-07-12 13:15:10,755 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:10,755 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:10,755 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:10,755 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:10,756 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:10,761 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:15:10,763 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167710763"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167710763"}]},"ts":"1689167710763"} 2023-07-12 13:15:10,764 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689167710763"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167710763"}]},"ts":"1689167710763"} 2023-07-12 13:15:10,764 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167710763"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167710763"}]},"ts":"1689167710763"} 2023-07-12 13:15:10,767 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-12 13:15:10,768 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:15:10,768 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167710768"}]},"ts":"1689167710768"} 2023-07-12 13:15:10,769 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-07-12 13:15:10,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=684e9c34724c737ee5eb5d368452e637, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9662635c9aef48a82b6818321244591, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c3dd1c27a1a45c43f96b95fb3aa34b8, ASSIGN}] 2023-07-12 13:15:10,775 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9662635c9aef48a82b6818321244591, ASSIGN 2023-07-12 13:15:10,775 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c3dd1c27a1a45c43f96b95fb3aa34b8, ASSIGN 2023-07-12 13:15:10,775 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=684e9c34724c737ee5eb5d368452e637, ASSIGN 2023-07-12 13:15:10,776 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c3dd1c27a1a45c43f96b95fb3aa34b8, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:15:10,776 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=684e9c34724c737ee5eb5d368452e637, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:15:10,776 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9662635c9aef48a82b6818321244591, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:15:10,927 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=684e9c34724c737ee5eb5d368452e637, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:10,927 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c9662635c9aef48a82b6818321244591, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:10,927 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167710927"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167710927"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167710927"}]},"ts":"1689167710927"} 2023-07-12 13:15:10,927 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=9c3dd1c27a1a45c43f96b95fb3aa34b8, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:10,928 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689167710927"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167710927"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167710927"}]},"ts":"1689167710927"} 2023-07-12 13:15:10,928 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167710927"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167710927"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167710927"}]},"ts":"1689167710927"} 2023-07-12 13:15:10,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure 684e9c34724c737ee5eb5d368452e637, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:10,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure c9662635c9aef48a82b6818321244591, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:10,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 9c3dd1c27a1a45c43f96b95fb3aa34b8, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:11,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-12 13:15:11,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:11,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9c3dd1c27a1a45c43f96b95fb3aa34b8, NAME => 'testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 13:15:11,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:11,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:11,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:11,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:11,089 INFO [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:11,090 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 2023-07-12 13:15:11,090 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 2023-07-12 13:15:11,090 INFO [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c3dd1c27a1a45c43f96b95fb3aa34b8 columnFamilyName family1 2023-07-12 13:15:11,092 INFO [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(310): Store=9c3dd1c27a1a45c43f96b95fb3aa34b8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:11,092 INFO [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:11,093 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2 2023-07-12 13:15:11,093 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2 2023-07-12 13:15:11,093 INFO [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c3dd1c27a1a45c43f96b95fb3aa34b8 columnFamilyName family2 2023-07-12 13:15:11,095 INFO [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(310): Store=9c3dd1c27a1a45c43f96b95fb3aa34b8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:11,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:11,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:11,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:15:11,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:11,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:15:11,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 9c3dd1c27a1a45c43f96b95fb3aa34b8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72493426, jitterRate=0.08023622632026672}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:15:11,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:11,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8., pid=85, masterSystemTime=1689167711082 2023-07-12 13:15:11,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:11,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:11,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:11,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 684e9c34724c737ee5eb5d368452e637, NAME => 'testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 13:15:11,102 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=9c3dd1c27a1a45c43f96b95fb3aa34b8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:11,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:11,102 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167711102"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167711102"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167711102"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167711102"}]},"ts":"1689167711102"} 2023-07-12 13:15:11,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:11,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:11,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:11,104 INFO [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:11,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-07-12 13:15:11,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 9c3dd1c27a1a45c43f96b95fb3aa34b8, server=jenkins-hbase17.apache.org,41721,1689167613545 in 173 msec 2023-07-12 13:15:11,105 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1 2023-07-12 13:15:11,105 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1 2023-07-12 13:15:11,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c3dd1c27a1a45c43f96b95fb3aa34b8, ASSIGN in 332 msec 2023-07-12 13:15:11,105 INFO [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 684e9c34724c737ee5eb5d368452e637 columnFamilyName family1 2023-07-12 13:15:11,106 INFO [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(310): Store=684e9c34724c737ee5eb5d368452e637/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:11,107 INFO [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:11,108 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2 2023-07-12 13:15:11,108 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2 2023-07-12 13:15:11,108 INFO [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 684e9c34724c737ee5eb5d368452e637 columnFamilyName family2 2023-07-12 13:15:11,109 INFO [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(310): Store=684e9c34724c737ee5eb5d368452e637/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:11,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:11,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:11,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:15:11,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:11,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:15:11,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 684e9c34724c737ee5eb5d368452e637; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72317949, jitterRate=0.07762141525745392}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:15:11,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:11,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637., pid=83, masterSystemTime=1689167711082 2023-07-12 13:15:11,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:11,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:11,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:11,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c9662635c9aef48a82b6818321244591, NAME => 'testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.', STARTKEY => '1', ENDKEY => '2'} 2023-07-12 13:15:11,116 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=684e9c34724c737ee5eb5d368452e637, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:11,117 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167711116"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167711116"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167711116"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167711116"}]},"ts":"1689167711116"} 2023-07-12 13:15:11,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c9662635c9aef48a82b6818321244591 2023-07-12 13:15:11,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:11,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for c9662635c9aef48a82b6818321244591 2023-07-12 13:15:11,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for c9662635c9aef48a82b6818321244591 2023-07-12 13:15:11,118 INFO [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c9662635c9aef48a82b6818321244591 2023-07-12 13:15:11,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=80 2023-07-12 13:15:11,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure 684e9c34724c737ee5eb5d368452e637, server=jenkins-hbase17.apache.org,41721,1689167613545 in 189 msec 2023-07-12 13:15:11,120 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1 2023-07-12 13:15:11,120 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1 2023-07-12 13:15:11,120 INFO [StoreOpener-c9662635c9aef48a82b6818321244591-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9662635c9aef48a82b6818321244591 columnFamilyName family1 2023-07-12 13:15:11,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=684e9c34724c737ee5eb5d368452e637, ASSIGN in 348 msec 2023-07-12 13:15:11,121 INFO [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(310): Store=c9662635c9aef48a82b6818321244591/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:11,121 INFO [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c9662635c9aef48a82b6818321244591 2023-07-12 13:15:11,123 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2 2023-07-12 13:15:11,123 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2 2023-07-12 13:15:11,123 INFO [StoreOpener-c9662635c9aef48a82b6818321244591-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9662635c9aef48a82b6818321244591 columnFamilyName family2 2023-07-12 13:15:11,124 INFO [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(310): Store=c9662635c9aef48a82b6818321244591/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:11,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591 2023-07-12 13:15:11,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591 2023-07-12 13:15:11,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:15:11,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for c9662635c9aef48a82b6818321244591 2023-07-12 13:15:11,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:15:11,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened c9662635c9aef48a82b6818321244591; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67012605, jitterRate=-0.0014343708753585815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:15:11,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:11,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591., pid=84, masterSystemTime=1689167711082 2023-07-12 13:15:11,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:11,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:11,134 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c9662635c9aef48a82b6818321244591, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:11,134 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689167711134"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167711134"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167711134"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167711134"}]},"ts":"1689167711134"} 2023-07-12 13:15:11,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=81 2023-07-12 13:15:11,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure c9662635c9aef48a82b6818321244591, server=jenkins-hbase17.apache.org,41721,1689167613545 in 206 msec 2023-07-12 13:15:11,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-07-12 13:15:11,139 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9662635c9aef48a82b6818321244591, ASSIGN in 365 msec 2023-07-12 13:15:11,139 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:15:11,139 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167711139"}]},"ts":"1689167711139"} 2023-07-12 13:15:11,140 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-07-12 13:15:11,142 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:15:11,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2290 sec 2023-07-12 13:15:12,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-12 13:15:12,028 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-07-12 13:15:12,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:12,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:12,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:12,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:15:12,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-12 13:15:12,051 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-12 13:15:12,051 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:12,051 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-12 13:15:12,051 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-12 13:15:12,051 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:12,051 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:12,052 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:12,052 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:12,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:12,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:12,052 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:12,052 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:15:12,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:12,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:15:12,074 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:15:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:12,074 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c3fa551 to 127.0.0.1:51470 2023-07-12 13:15:12,074 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-12 13:15:12,074 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:15:12,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-12 13:15:12,077 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:15:12,077 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-12 13:15:12,077 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2171388d to 127.0.0.1:51470 2023-07-12 13:15:12,077 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:12,077 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:15:12,077 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-12 13:15:12,082 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:12,082 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. started... 2023-07-12 13:15:12,082 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:15:12,082 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:15:12,082 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:12,082 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. started... 2023-07-12 13:15:12,082 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:12,083 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. started... 2023-07-12 13:15:12,083 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9c3dd1c27a1a45c43f96b95fb3aa34b8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-12 13:15:12,083 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:15:12,083 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c9662635c9aef48a82b6818321244591 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-12 13:15:12,083 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f0fc1a2 to 127.0.0.1:51470 2023-07-12 13:15:12,083 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 684e9c34724c737ee5eb5d368452e637 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-12 13:15:12,084 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:15:12,086 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x255f705d to 127.0.0.1:51470 2023-07-12 13:15:12,086 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:15:12,090 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:15:12,090 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fc8c75e to 127.0.0.1:51470 2023-07-12 13:15:12,090 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:15:12,091 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:15:12,091 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e6f458c to 127.0.0.1:51470 2023-07-12 13:15:12,091 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:15:12,091 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53f0e06d to 127.0.0.1:51470 2023-07-12 13:15:12,091 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:15:12,512 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712fe9d1084ca5b41a18a37f96c6efbdb0f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230712fe9d1084ca5b41a18a37f96c6efbdb0f 2023-07-12 13:15:12,513 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307120941e4843624445ea426f7f9d1d3b7f1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307120941e4843624445ea426f7f9d1d3b7f1 2023-07-12 13:15:12,513 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712efb92ae907634cb6a2f4e17a5a44fd86 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712efb92ae907634cb6a2f4e17a5a44fd86 2023-07-12 13:15:12,922 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family1/ac3029b2ba8840569b178aa508e0ea97 2023-07-12 13:15:12,922 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family1/2aa69aa56e324088b3e9ae8eb04f5204 2023-07-12 13:15:12,923 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family1/98c96d9ec7164b0c9e4e2740144261e4 2023-07-12 13:15:13,345 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712bf963372f6fd495a9116d2b4d7cee949 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712bf963372f6fd495a9116d2b4d7cee949 2023-07-12 13:15:13,345 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712a8300da1f2cd4b4186d4bccd666e2d8b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712a8300da1f2cd4b4186d4bccd666e2d8b 2023-07-12 13:15:13,345 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307120a481f0d5cdc42ef8725cf3fcc81f195 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307120a481f0d5cdc42ef8725cf3fcc81f195 2023-07-12 13:15:13,755 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family2/9f940e710eea4544a0ea53b174ebee2b 2023-07-12 13:15:13,759 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family2/dbe2d55ba4064942b00e7acd854624a3 2023-07-12 13:15:13,759 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family2/e360b016c292406c9af549f09c05cf50 2023-07-12 13:15:13,765 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family1/2aa69aa56e324088b3e9ae8eb04f5204 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/2aa69aa56e324088b3e9ae8eb04f5204 2023-07-12 13:15:13,766 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family1/98c96d9ec7164b0c9e4e2740144261e4 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/98c96d9ec7164b0c9e4e2740144261e4 2023-07-12 13:15:13,766 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family1/ac3029b2ba8840569b178aa508e0ea97 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/ac3029b2ba8840569b178aa508e0ea97 2023-07-12 13:15:13,771 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/2aa69aa56e324088b3e9ae8eb04f5204, entries=4, sequenceid=5, filesize=5.4 K 2023-07-12 13:15:13,771 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/98c96d9ec7164b0c9e4e2740144261e4, entries=4, sequenceid=5, filesize=5.4 K 2023-07-12 13:15:13,771 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/ac3029b2ba8840569b178aa508e0ea97, entries=4, sequenceid=5, filesize=5.4 K 2023-07-12 13:15:13,771 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family2/9f940e710eea4544a0ea53b174ebee2b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/9f940e710eea4544a0ea53b174ebee2b 2023-07-12 13:15:13,772 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family2/dbe2d55ba4064942b00e7acd854624a3 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/dbe2d55ba4064942b00e7acd854624a3 2023-07-12 13:15:13,772 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family2/e360b016c292406c9af549f09c05cf50 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/e360b016c292406c9af549f09c05cf50 2023-07-12 13:15:13,776 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/9f940e710eea4544a0ea53b174ebee2b, entries=2, sequenceid=5, filesize=5.1 K 2023-07-12 13:15:13,777 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/e360b016c292406c9af549f09c05cf50, entries=2, sequenceid=5, filesize=5.1 K 2023-07-12 13:15:13,777 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/dbe2d55ba4064942b00e7acd854624a3, entries=2, sequenceid=5, filesize=5.1 K 2023-07-12 13:15:13,777 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9c3dd1c27a1a45c43f96b95fb3aa34b8 in 1695ms, sequenceid=5, compaction requested=false 2023-07-12 13:15:13,777 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-07-12 13:15:13,777 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 684e9c34724c737ee5eb5d368452e637 in 1694ms, sequenceid=5, compaction requested=false 2023-07-12 13:15:13,778 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:13,778 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:13,778 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c9662635c9aef48a82b6818321244591 in 1694ms, sequenceid=5, compaction requested=false 2023-07-12 13:15:13,778 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:13,778 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:13,778 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:15:13,778 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:13,778 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:15:13,778 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:13,778 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:15:13,778 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:15:13,778 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,779 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-12 13:15:13,779 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-12 13:15:13,779 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:13,779 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:13,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:13,780 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:13,780 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:15:13,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:13,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:13,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:13,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:13,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-12 13:15:13,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e69cd9a[Count = 0] remaining members to acquire global barrier 2023-07-12 13:15:13,781 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-12 13:15:13,781 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:13,781 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:13,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:13,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:13,782 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-12 13:15:13,782 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,782 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:15:13,782 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-12 13:15:13,782 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:15:13,782 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-12 13:15:13,782 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,782 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:13,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:13,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:13,782 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-12 13:15:13,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:13,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:13,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:13,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:13,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:13,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:15:13,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-12 13:15:13,784 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-12 13:15:13,784 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:15:13,784 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:15:13,784 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-12 13:15:13,784 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:15:13,785 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:13,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:13,785 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:13,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:13,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:13,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:13,785 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:13,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:13,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:13,785 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:13,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:13,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:13,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:13,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:13,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:13,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,786 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:13,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:13,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,787 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,787 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:13,787 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:13,788 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:13,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-07-12 13:15:13,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:13,787 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:13,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:13,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-12 13:15:13,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:15:13,788 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:13,788 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,788 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:13,788 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:13,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:13,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:13,788 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:13,788 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-12 13:15:13,788 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:15:13,888 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:15:13,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:15:13,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:13,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:13,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:13,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:15:13,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-07-12 13:15:13,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-12 13:15:13,895 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-12 13:15:13,895 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:13,895 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-12 13:15:13,895 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-12 13:15:13,895 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:13,895 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:13,896 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,896 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:13,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:13,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:13,896 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:13,896 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:15:13,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:13,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:13,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:15:13,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:13,897 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-12 13:15:13,898 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-07-12 13:15:13,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-12 13:15:13,898 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-12 13:15:13,898 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:13,898 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-12 13:15:13,898 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:13,898 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:15:13,898 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:13,898 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:15:13,898 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:13,898 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. started... 2023-07-12 13:15:13,898 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. started... 2023-07-12 13:15:13,898 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. started... 2023-07-12 13:15:13,898 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 684e9c34724c737ee5eb5d368452e637 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-12 13:15:13,898 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c9662635c9aef48a82b6818321244591 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-12 13:15:13,898 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9c3dd1c27a1a45c43f96b95fb3aa34b8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-12 13:15:14,315 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307123176af7e6cf648028f20c159f6cbd3da to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307123176af7e6cf648028f20c159f6cbd3da 2023-07-12 13:15:14,321 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071287169779b97148ee9f3892d1e355d2b0 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071287169779b97148ee9f3892d1e355d2b0 2023-07-12 13:15:14,325 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071210e4d113160e4b619b13c7fb902e4140 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071210e4d113160e4b619b13c7fb902e4140 2023-07-12 13:15:14,720 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family1/058aa9a11dd54cc7941b7afb8f7de47b 2023-07-12 13:15:14,726 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family1/04c0fd3198224028a40240310b5556a4 2023-07-12 13:15:14,729 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family1/67b7de58b2134506aa21b79c5ead4bb4 2023-07-12 13:15:14,746 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307120fa552a4181747fa992ac3bb48194855 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307120fa552a4181747fa992ac3bb48194855 2023-07-12 13:15:15,132 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 13:15:15,144 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071261d4b3e7233744fd80b4cef042833cba to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071261d4b3e7233744fd80b4cef042833cba 2023-07-12 13:15:15,145 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712d963b36ae7e441389a23a318f69a695d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712d963b36ae7e441389a23a318f69a695d 2023-07-12 13:15:15,152 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family2/b1bb4c69875342b583d1bb33bb5f0812 2023-07-12 13:15:15,156 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family2/1a646d40dbb346f29d1105dfa4bf26d4 2023-07-12 13:15:15,157 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family1/67b7de58b2134506aa21b79c5ead4bb4 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/67b7de58b2134506aa21b79c5ead4bb4 2023-07-12 13:15:15,160 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family1/04c0fd3198224028a40240310b5556a4 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/04c0fd3198224028a40240310b5556a4 2023-07-12 13:15:15,161 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/67b7de58b2134506aa21b79c5ead4bb4, entries=4, sequenceid=9, filesize=5.4 K 2023-07-12 13:15:15,162 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family2/b1bb4c69875342b583d1bb33bb5f0812 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/b1bb4c69875342b583d1bb33bb5f0812 2023-07-12 13:15:15,163 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/04c0fd3198224028a40240310b5556a4, entries=4, sequenceid=9, filesize=5.4 K 2023-07-12 13:15:15,164 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family2/1a646d40dbb346f29d1105dfa4bf26d4 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/1a646d40dbb346f29d1105dfa4bf26d4 2023-07-12 13:15:15,165 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/b1bb4c69875342b583d1bb33bb5f0812, entries=2, sequenceid=9, filesize=5.1 K 2023-07-12 13:15:15,166 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c9662635c9aef48a82b6818321244591 in 1268ms, sequenceid=9, compaction requested=false 2023-07-12 13:15:15,166 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:15,166 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:15,166 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:15:15,168 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/1a646d40dbb346f29d1105dfa4bf26d4, entries=2, sequenceid=9, filesize=5.1 K 2023-07-12 13:15:15,168 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 684e9c34724c737ee5eb5d368452e637 in 1270ms, sequenceid=9, compaction requested=false 2023-07-12 13:15:15,168 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:15,168 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:15,168 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:15:15,554 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family2/f1c8b53a8c0943b1a10cd93917fcfc1b 2023-07-12 13:15:15,564 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family1/058aa9a11dd54cc7941b7afb8f7de47b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/058aa9a11dd54cc7941b7afb8f7de47b 2023-07-12 13:15:15,570 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/058aa9a11dd54cc7941b7afb8f7de47b, entries=4, sequenceid=9, filesize=5.4 K 2023-07-12 13:15:15,571 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family2/f1c8b53a8c0943b1a10cd93917fcfc1b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/f1c8b53a8c0943b1a10cd93917fcfc1b 2023-07-12 13:15:15,575 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/f1c8b53a8c0943b1a10cd93917fcfc1b, entries=2, sequenceid=9, filesize=5.1 K 2023-07-12 13:15:15,576 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9c3dd1c27a1a45c43f96b95fb3aa34b8 in 1678ms, sequenceid=9, compaction requested=false 2023-07-12 13:15:15,576 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:15,576 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:15,576 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:15:15,576 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:15:15,576 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,576 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-12 13:15:15,576 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-12 13:15:15,578 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,578 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:15,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:15,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:15,579 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:15,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:15,579 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:15:15,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:15,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:15,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:15,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-12 13:15:15,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@718edbb4[Count = 0] remaining members to acquire global barrier 2023-07-12 13:15:15,581 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-12 13:15:15,581 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:15,581 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:15,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:15,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:15,582 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-12 13:15:15,582 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-12 13:15:15,582 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:15:15,582 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,582 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:15:15,582 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-12 13:15:15,582 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,582 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:15,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:15,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:15,583 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-12 13:15:15,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:15,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:15,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:15,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:15,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:15,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:15:15,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-12 13:15:15,585 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-12 13:15:15,585 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:15:15,585 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:15:15,585 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-12 13:15:15,585 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:15:15,586 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:15,586 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:15,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:15,586 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:15,586 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,587 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:15,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:15,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,589 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,589 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:15,589 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:15,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:15,589 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:15,589 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:15,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:15,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-12 13:15:15,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:15:15,589 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:15,589 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,589 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:15,589 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:15,589 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:15,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:15,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:15,590 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-12 13:15:15,590 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:15:15,690 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:15:15,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:15:15,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:15,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:15,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:15,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:15:15,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-07-12 13:15:15,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-12 13:15:15,700 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-12 13:15:15,701 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:15,701 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-12 13:15:15,701 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-12 13:15:15,701 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:15,701 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:15,703 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:15,703 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:15,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:15,703 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:15,703 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:15:15,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:15,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:15,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:15:15,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:15,705 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-12 13:15:15,705 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-07-12 13:15:15,705 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-12 13:15:15,705 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-12 13:15:15,705 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:15,705 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-12 13:15:15,705 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:15,706 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. started... 2023-07-12 13:15:15,706 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:15,706 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:15:15,706 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:15:15,706 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 684e9c34724c737ee5eb5d368452e637 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-12 13:15:15,706 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:15,706 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. started... 2023-07-12 13:15:15,706 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. started... 2023-07-12 13:15:15,706 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c9662635c9aef48a82b6818321244591 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-12 13:15:15,706 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9c3dd1c27a1a45c43f96b95fb3aa34b8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-12 13:15:16,132 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307128c746917627b42f58f61962d2d2b7b5a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307128c746917627b42f58f61962d2d2b7b5a 2023-07-12 13:15:16,132 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712871db3f5f2fd46998a2101e6c7bb7c28 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230712871db3f5f2fd46998a2101e6c7bb7c28 2023-07-12 13:15:16,132 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307125dec2e95a11f4647a869cce690c3a76a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307125dec2e95a11f4647a869cce690c3a76a 2023-07-12 13:15:16,146 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family1/add5584e719b4cd3ab22db193414bd4a 2023-07-12 13:15:16,545 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family1/fb5dcfa8cda6468c810a8804e8fcdad2 2023-07-12 13:15:16,548 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family1/7127f07493ed4f5da2d22b562a0ea1ed 2023-07-12 13:15:16,560 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712194bb5d6ee05477a980962d19dcee939 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712194bb5d6ee05477a980962d19dcee939 2023-07-12 13:15:16,573 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712fa1b52251707413bb85d488e61c4678c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712fa1b52251707413bb85d488e61c4678c 2023-07-12 13:15:16,971 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family2/9b7a0e928eb043c6a64ccdcdcff789f1 2023-07-12 13:15:16,977 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307121cf5ae7f706048c4bd6f2d3abbaa6c5d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307121cf5ae7f706048c4bd6f2d3abbaa6c5d 2023-07-12 13:15:16,978 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family2/8cffb17142ac4e04a69c8ae5d0ad3b2a 2023-07-12 13:15:16,978 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family1/add5584e719b4cd3ab22db193414bd4a as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/add5584e719b4cd3ab22db193414bd4a 2023-07-12 13:15:16,983 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family2/becbb35b762347e9a93052b8104401a9 2023-07-12 13:15:16,983 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/add5584e719b4cd3ab22db193414bd4a, entries=4, sequenceid=13, filesize=5.4 K 2023-07-12 13:15:16,983 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family1/7127f07493ed4f5da2d22b562a0ea1ed as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/7127f07493ed4f5da2d22b562a0ea1ed 2023-07-12 13:15:16,984 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family2/9b7a0e928eb043c6a64ccdcdcff789f1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/9b7a0e928eb043c6a64ccdcdcff789f1 2023-07-12 13:15:16,988 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family1/fb5dcfa8cda6468c810a8804e8fcdad2 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/fb5dcfa8cda6468c810a8804e8fcdad2 2023-07-12 13:15:16,989 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/7127f07493ed4f5da2d22b562a0ea1ed, entries=4, sequenceid=13, filesize=5.4 K 2023-07-12 13:15:16,989 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/9b7a0e928eb043c6a64ccdcdcff789f1, entries=2, sequenceid=13, filesize=5.1 K 2023-07-12 13:15:16,990 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c9662635c9aef48a82b6818321244591 in 1283ms, sequenceid=13, compaction requested=true 2023-07-12 13:15:16,990 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:16,990 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family2/8cffb17142ac4e04a69c8ae5d0ad3b2a as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/8cffb17142ac4e04a69c8ae5d0ad3b2a 2023-07-12 13:15:16,990 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:16,990 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:15:16,993 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/fb5dcfa8cda6468c810a8804e8fcdad2, entries=4, sequenceid=13, filesize=5.4 K 2023-07-12 13:15:16,994 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family2/becbb35b762347e9a93052b8104401a9 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/becbb35b762347e9a93052b8104401a9 2023-07-12 13:15:16,994 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/8cffb17142ac4e04a69c8ae5d0ad3b2a, entries=2, sequenceid=13, filesize=5.1 K 2023-07-12 13:15:16,995 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9c3dd1c27a1a45c43f96b95fb3aa34b8 in 1289ms, sequenceid=13, compaction requested=true 2023-07-12 13:15:16,995 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:16,995 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:16,995 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:15:16,998 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/becbb35b762347e9a93052b8104401a9, entries=2, sequenceid=13, filesize=5.1 K 2023-07-12 13:15:16,999 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 684e9c34724c737ee5eb5d368452e637 in 1293ms, sequenceid=13, compaction requested=true 2023-07-12 13:15:16,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:16,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:16,999 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:15:16,999 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:15:16,999 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:16,999 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-12 13:15:16,999 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-12 13:15:17,001 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,001 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:17,002 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:17,002 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:15:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:17,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:17,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-12 13:15:17,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e69a99a[Count = 0] remaining members to acquire global barrier 2023-07-12 13:15:17,003 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-12 13:15:17,003 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:17,003 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:17,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:17,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:17,004 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-12 13:15:17,004 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,004 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:15:17,004 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-12 13:15:17,004 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:15:17,004 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-12 13:15:17,004 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,004 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:17,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:17,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:17,005 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-12 13:15:17,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:17,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:17,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:17,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:17,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:17,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:15:17,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-12 13:15:17,006 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-12 13:15:17,006 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:15:17,006 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:15:17,006 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-12 13:15:17,006 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:15:17,007 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:17,007 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:17,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:17,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:17,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:17,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:17,007 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:17,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:17,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:17,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:17,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:17,008 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:17,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:17,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:17,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,009 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,010 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,010 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:17,010 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:17,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-12 13:15:17,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:15:17,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:17,010 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:17,010 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:17,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:17,010 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-12 13:15:17,010 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:15:17,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-07-12 13:15:17,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:17,010 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:17,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:17,010 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,010 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:17,010 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:17,011 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:17,110 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:15:17,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:15:17,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:17,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:17,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:17,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:15:17,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-07-12 13:15:17,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-12 13:15:17,118 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-12 13:15:17,118 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:17,118 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-12 13:15:17,118 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-12 13:15:17,119 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:17,119 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:17,120 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:17,120 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:17,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:17,120 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:17,120 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:15:17,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:17,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:17,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:15:17,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:17,121 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-12 13:15:17,121 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-07-12 13:15:17,121 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-12 13:15:17,121 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-12 13:15:17,122 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:17,122 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-12 13:15:17,122 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:17,122 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. started... 2023-07-12 13:15:17,122 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 684e9c34724c737ee5eb5d368452e637 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-12 13:15:17,124 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:17,124 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. started... 2023-07-12 13:15:17,124 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9c3dd1c27a1a45c43f96b95fb3aa34b8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-12 13:15:17,127 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:15:17,127 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:15:17,127 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:17,127 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. started... 2023-07-12 13:15:17,127 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c9662635c9aef48a82b6818321244591 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-12 13:15:17,142 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071245cdeff6f95d450785c963fbc1a8c753 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071245cdeff6f95d450785c963fbc1a8c753 2023-07-12 13:15:17,143 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712900d4cd6d6eb42819a02679754927ecc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712900d4cd6d6eb42819a02679754927ecc 2023-07-12 13:15:17,545 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712eb54a68ddba04ce78456026abc3bb59f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230712eb54a68ddba04ce78456026abc3bb59f 2023-07-12 13:15:17,546 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family1/61ac1037c26741818a4ef3077263a14e 2023-07-12 13:15:17,549 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family1/8b96dfbdc0934784a142ee622c889b86 2023-07-12 13:15:17,556 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family1/6139ff44e92a436c835fe1ada2e7d0dc 2023-07-12 13:15:17,976 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712b587a16d2cdb4a8fad8654cd7f050264 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712b587a16d2cdb4a8fad8654cd7f050264 2023-07-12 13:15:17,980 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712c4f0c4cee5ad4e53a0dac52b7ab420c2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712c4f0c4cee5ad4e53a0dac52b7ab420c2 2023-07-12 13:15:17,981 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712ca44b32066aa42c5896aaa0d7733c3ef to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712ca44b32066aa42c5896aaa0d7733c3ef 2023-07-12 13:15:17,983 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family2/e459491ae4344c89aefef7bff114515a 2023-07-12 13:15:17,988 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family2/9edbf3c966d24513a206c3a825c590d1 2023-07-12 13:15:17,988 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family1/61ac1037c26741818a4ef3077263a14e as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/61ac1037c26741818a4ef3077263a14e 2023-07-12 13:15:17,992 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/61ac1037c26741818a4ef3077263a14e, entries=4, sequenceid=17, filesize=5.4 K 2023-07-12 13:15:17,993 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family2/e459491ae4344c89aefef7bff114515a as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/e459491ae4344c89aefef7bff114515a 2023-07-12 13:15:17,994 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family1/6139ff44e92a436c835fe1ada2e7d0dc as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/6139ff44e92a436c835fe1ada2e7d0dc 2023-07-12 13:15:17,997 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/6139ff44e92a436c835fe1ada2e7d0dc, entries=4, sequenceid=17, filesize=5.4 K 2023-07-12 13:15:17,998 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family2/9edbf3c966d24513a206c3a825c590d1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/9edbf3c966d24513a206c3a825c590d1 2023-07-12 13:15:18,001 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/e459491ae4344c89aefef7bff114515a, entries=2, sequenceid=17, filesize=5.1 K 2023-07-12 13:15:18,002 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9c3dd1c27a1a45c43f96b95fb3aa34b8 in 878ms, sequenceid=17, compaction requested=true 2023-07-12 13:15:18,002 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:18,002 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:18,002 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:15:18,002 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/9edbf3c966d24513a206c3a825c590d1, entries=2, sequenceid=17, filesize=5.1 K 2023-07-12 13:15:18,002 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 684e9c34724c737ee5eb5d368452e637 in 880ms, sequenceid=17, compaction requested=true 2023-07-12 13:15:18,002 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:18,003 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:18,003 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:15:18,387 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family2/0cd811c0249f434e9a2e8af031613111 2023-07-12 13:15:18,392 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family1/8b96dfbdc0934784a142ee622c889b86 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/8b96dfbdc0934784a142ee622c889b86 2023-07-12 13:15:18,396 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/8b96dfbdc0934784a142ee622c889b86, entries=4, sequenceid=17, filesize=5.4 K 2023-07-12 13:15:18,397 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family2/0cd811c0249f434e9a2e8af031613111 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/0cd811c0249f434e9a2e8af031613111 2023-07-12 13:15:18,405 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/0cd811c0249f434e9a2e8af031613111, entries=2, sequenceid=17, filesize=5.1 K 2023-07-12 13:15:18,406 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c9662635c9aef48a82b6818321244591 in 1279ms, sequenceid=17, compaction requested=true 2023-07-12 13:15:18,406 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:18,406 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:18,406 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:15:18,406 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:15:18,407 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,407 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-12 13:15:18,407 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-12 13:15:18,408 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:18,408 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:18,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:18,408 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:18,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:18,408 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:15:18,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:18,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:18,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:18,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-12 13:15:18,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d04dbbb[Count = 0] remaining members to acquire global barrier 2023-07-12 13:15:18,409 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-12 13:15:18,409 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:18,410 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:18,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:18,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:18,410 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-12 13:15:18,410 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-12 13:15:18,410 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:15:18,410 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,410 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:15:18,411 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,411 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-12 13:15:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:18,411 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:18,411 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-12 13:15:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:15:18,413 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-12 13:15:18,413 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:15:18,413 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:15:18,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-12 13:15:18,413 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-12 13:15:18,413 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:15:18,414 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:18,414 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:18,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:18,414 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:18,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:18,414 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:18,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:18,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:18,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:18,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:18,415 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:18,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:18,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,417 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,417 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:18,417 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:18,417 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:18,417 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:18,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-07-12 13:15:18,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-12 13:15:18,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:15:18,417 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:18,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:18,417 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:18,417 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:18,417 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:18,417 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-12 13:15:18,417 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:18,417 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:15:18,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:18,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:18,517 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:15:18,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:15:18,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-12 13:15:18,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689167718529 (current time:1689167718529). 2023-07-12 13:15:18,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 13:15:18,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] zookeeper.ReadOnlyZKClient(139): Connect 0x4c9e12b9 to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:15:18,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e088246, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:15:18,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:15:18,541 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:15:18,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c9e12b9 to 127.0.0.1:51470 2023-07-12 13:15:18,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:15:18,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 13:15:18,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-12 13:15:18,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-12 13:15:18,553 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-12 13:15:18,554 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1689168318554 2023-07-12 13:15:18,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-12 13:15:18,554 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1689167718518 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-07-12 13:15:18,556 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-12 13:15:18,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-07-12 13:15:18,557 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-07-12 13:15:18,557 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-07-12 13:15:18,558 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1689168318558 2023-07-12 13:15:18,560 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-07-12 13:15:18,560 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 13:15:18,660 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 13:15:18,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-12 13:15:18,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-12 13:15:18,668 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 13:15:18,869 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 13:15:18,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-12 13:15:18,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-12 13:15:18,871 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 13:15:18,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1689167718518 2023-07-12 13:15:18,973 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1689167718518' 2023-07-12 13:15:18,974 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 13:15:18,974 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1689167718518' starting 'acquire' 2023-07-12 13:15:18,974 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1689167718518', kicking off acquire phase on members. 2023-07-12 13:15:18,975 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1689167718518 2023-07-12 13:15:18,975 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1689167718518 2023-07-12 13:15:18,977 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 13:15:18,977 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1689167718518/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 13:15:18,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 13:15:18,978 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1689167718518/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1689167718518 2023-07-12 13:15:18,978 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:15:18,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1689167718518 2023-07-12 13:15:18,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-07-12 13:15:18,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1689167718518 2023-07-12 13:15:18,979 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1689167718518 from table testCompactionWithHFileLink type FLUSH 2023-07-12 13:15:18,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1689167718518 2023-07-12 13:15:18,981 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1689167718518' with timeout 300000ms 2023-07-12 13:15:18,981 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 13:15:18,981 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1689167718518' starting 'acquire' stage 2023-07-12 13:15:18,982 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1689167718518' locally acquired 2023-07-12 13:15:18,982 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (snaptb-1689167718518) in zk 2023-07-12 13:15:18,983 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1689167718518 2023-07-12 13:15:18,983 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1689167718518/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1689167718518/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 13:15:18,983 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1689167718518 2023-07-12 13:15:18,983 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1689167718518' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:15:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689167718518 2023-07-12 13:15:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:18,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'snaptb-1689167718518' on coordinator 2023-07-12 13:15:18,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d71dc9c[Count = 0] remaining members to acquire global barrier 2023-07-12 13:15:18,984 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1689167718518' starting 'in-barrier' execution. 2023-07-12 13:15:18,984 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1689167718518 2023-07-12 13:15:18,985 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689167718518 2023-07-12 13:15:18,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1689167718518 2023-07-12 13:15:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1689167718518 2023-07-12 13:15:18,985 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1689167718518' received 'reached' from coordinator. 2023-07-12 13:15:18,985 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1689167718518/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:18,985 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:15:18,986 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:18,986 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:18,986 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-07-12 13:15:18,986 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:18,986 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 13:15:18,986 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. started... 2023-07-12 13:15:18,986 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. started... 2023-07-12 13:15:18,986 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. started... 2023-07-12 13:15:18,986 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:18,986 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:18,986 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:18,987 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.' region-info for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,987 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.' region-info for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,987 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.' region-info for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,991 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 13:15:18,991 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 13:15:18,991 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 13:15:18,995 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/2aa69aa56e324088b3e9ae8eb04f5204, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/058aa9a11dd54cc7941b7afb8f7de47b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/7127f07493ed4f5da2d22b562a0ea1ed, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/61ac1037c26741818a4ef3077263a14e] hfiles 2023-07-12 13:15:18,995 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/98c96d9ec7164b0c9e4e2740144261e4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/67b7de58b2134506aa21b79c5ead4bb4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/add5584e719b4cd3ab22db193414bd4a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/8b96dfbdc0934784a142ee622c889b86] hfiles 2023-07-12 13:15:18,995 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/98c96d9ec7164b0c9e4e2740144261e4 for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,995 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/ac3029b2ba8840569b178aa508e0ea97, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/04c0fd3198224028a40240310b5556a4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/fb5dcfa8cda6468c810a8804e8fcdad2, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/6139ff44e92a436c835fe1ada2e7d0dc] hfiles 2023-07-12 13:15:18,995 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/2aa69aa56e324088b3e9ae8eb04f5204 for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,995 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/ac3029b2ba8840569b178aa508e0ea97 for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,998 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/058aa9a11dd54cc7941b7afb8f7de47b for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,998 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/7127f07493ed4f5da2d22b562a0ea1ed for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,998 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/61ac1037c26741818a4ef3077263a14e for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,998 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/04c0fd3198224028a40240310b5556a4 for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/9f940e710eea4544a0ea53b174ebee2b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/f1c8b53a8c0943b1a10cd93917fcfc1b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/8cffb17142ac4e04a69c8ae5d0ad3b2a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/e459491ae4344c89aefef7bff114515a] hfiles 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/9f940e710eea4544a0ea53b174ebee2b for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/f1c8b53a8c0943b1a10cd93917fcfc1b for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/8cffb17142ac4e04a69c8ae5d0ad3b2a for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/e459491ae4344c89aefef7bff114515a for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,998 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/67b7de58b2134506aa21b79c5ead4bb4 for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/add5584e719b4cd3ab22db193414bd4a for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/8b96dfbdc0934784a142ee622c889b86 for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/fb5dcfa8cda6468c810a8804e8fcdad2 for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/dbe2d55ba4064942b00e7acd854624a3, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/b1bb4c69875342b583d1bb33bb5f0812, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/9b7a0e928eb043c6a64ccdcdcff789f1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/0cd811c0249f434e9a2e8af031613111] hfiles 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/6139ff44e92a436c835fe1ada2e7d0dc for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/dbe2d55ba4064942b00e7acd854624a3 for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/e360b016c292406c9af549f09c05cf50, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/1a646d40dbb346f29d1105dfa4bf26d4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/becbb35b762347e9a93052b8104401a9, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/9edbf3c966d24513a206c3a825c590d1] hfiles 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/e360b016c292406c9af549f09c05cf50 for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/1a646d40dbb346f29d1105dfa4bf26d4 for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/becbb35b762347e9a93052b8104401a9 for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/9edbf3c966d24513a206c3a825c590d1 for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/b1bb4c69875342b583d1bb33bb5f0812 for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/9b7a0e928eb043c6a64ccdcdcff789f1 for snapshot=snaptb-1689167718518 2023-07-12 13:15:18,999 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/0cd811c0249f434e9a2e8af031613111 for snapshot=snaptb-1689167718518 2023-07-12 13:15:19,171 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 13:15:19,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-12 13:15:19,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-12 13:15:19,172 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 13:15:19,406 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. completed. 2023-07-12 13:15:19,406 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:19,407 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. completed. 2023-07-12 13:15:19,407 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. completed. 2023-07-12 13:15:19,407 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:19,407 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:19,408 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-07-12 13:15:19,408 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-07-12 13:15:19,408 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-07-12 13:15:19,408 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-07-12 13:15:19,409 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:19,409 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1689167718518' locally completed 2023-07-12 13:15:19,409 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1689167718518' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:15:19,411 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689167718518/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:19,411 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1689167718518' has notified controller of completion 2023-07-12 13:15:19,411 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:19,411 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1689167718518' completed. 2023-07-12 13:15:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1689167718518/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 13:15:19,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:19,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:19,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689167718518 2023-07-12 13:15:19,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:19,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:19,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689167718518 2023-07-12 13:15:19,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:19,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1689167718518' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:15:19,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'snaptb-1689167718518', counting down latch. Waiting for 0 more 2023-07-12 13:15:19,415 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1689167718518' execution completed 2023-07-12 13:15:19,415 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:15:19,415 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:15:19,415 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1689167718518 2023-07-12 13:15:19,415 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1689167718518including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 13:15:19,417 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1689167718518 2023-07-12 13:15:19,417 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1689167718518 2023-07-12 13:15:19,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1689167718518 2023-07-12 13:15:19,417 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 13:15:19,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1689167718518 2023-07-12 13:15:19,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1689167718518 2023-07-12 13:15:19,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:19,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 13:15:19,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 13:15:19,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 13:15:19,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:19,418 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1689167718518/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:19,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1689167718518 2023-07-12 13:15:19,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689167718518 2023-07-12 13:15:19,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:19,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689167718518 2023-07-12 13:15:19,420 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1689167718518/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:19,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:19,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:19,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689167718518 2023-07-12 13:15:19,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:19,422 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1689167718518/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:19,422 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1689167718518 2023-07-12 13:15:19,422 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1689167718518 2023-07-12 13:15:19,422 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689167718518/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:19,422 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:19,423 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1689167718518 2023-07-12 13:15:19,422 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 13:15:19,422 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689167718518 2023-07-12 13:15:19,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 13:15:19,423 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-07-12 13:15:19,423 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 13:15:19,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 13:15:19,423 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689167718518 2023-07-12 13:15:19,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1689167718518 2023-07-12 13:15:19,423 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1689167718518 2023-07-12 13:15:19,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 13:15:19,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 13:15:19,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 13:15:19,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071210e4d113160e4b619b13c7fb902e4140, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307125dec2e95a11f4647a869cce690c3a76a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712900d4cd6d6eb42819a02679754927ecc, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712efb92ae907634cb6a2f4e17a5a44fd86, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307120941e4843624445ea426f7f9d1d3b7f1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307123176af7e6cf648028f20c159f6cbd3da, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071245cdeff6f95d450785c963fbc1a8c753, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230712871db3f5f2fd46998a2101e6c7bb7c28, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071287169779b97148ee9f3892d1e355d2b0, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307128c746917627b42f58f61962d2d2b7b5a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230712eb54a68ddba04ce78456026abc3bb59f, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230712fe9d1084ca5b41a18a37f96c6efbdb0f] mob files 2023-07-12 13:15:19,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071210e4d113160e4b619b13c7fb902e4140 2023-07-12 13:15:19,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307125dec2e95a11f4647a869cce690c3a76a 2023-07-12 13:15:19,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712900d4cd6d6eb42819a02679754927ecc 2023-07-12 13:15:19,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712efb92ae907634cb6a2f4e17a5a44fd86 2023-07-12 13:15:19,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307120941e4843624445ea426f7f9d1d3b7f1 2023-07-12 13:15:19,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307123176af7e6cf648028f20c159f6cbd3da 2023-07-12 13:15:19,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071245cdeff6f95d450785c963fbc1a8c753 2023-07-12 13:15:19,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230712871db3f5f2fd46998a2101e6c7bb7c28 2023-07-12 13:15:19,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071287169779b97148ee9f3892d1e355d2b0 2023-07-12 13:15:19,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307128c746917627b42f58f61962d2d2b7b5a 2023-07-12 13:15:19,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230712eb54a68ddba04ce78456026abc3bb59f 2023-07-12 13:15:19,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230712fe9d1084ca5b41a18a37f96c6efbdb0f 2023-07-12 13:15:19,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307120fa552a4181747fa992ac3bb48194855, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712194bb5d6ee05477a980962d19dcee939, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712bf963372f6fd495a9116d2b4d7cee949, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712c4f0c4cee5ad4e53a0dac52b7ab420c2, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307120a481f0d5cdc42ef8725cf3fcc81f195, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071261d4b3e7233744fd80b4cef042833cba, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712b587a16d2cdb4a8fad8654cd7f050264, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712fa1b52251707413bb85d488e61c4678c, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307121cf5ae7f706048c4bd6f2d3abbaa6c5d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712a8300da1f2cd4b4186d4bccd666e2d8b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712ca44b32066aa42c5896aaa0d7733c3ef, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712d963b36ae7e441389a23a318f69a695d] mob files 2023-07-12 13:15:19,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307120fa552a4181747fa992ac3bb48194855 2023-07-12 13:15:19,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712194bb5d6ee05477a980962d19dcee939 2023-07-12 13:15:19,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712bf963372f6fd495a9116d2b4d7cee949 2023-07-12 13:15:19,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712c4f0c4cee5ad4e53a0dac52b7ab420c2 2023-07-12 13:15:19,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307120a481f0d5cdc42ef8725cf3fcc81f195 2023-07-12 13:15:19,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071261d4b3e7233744fd80b4cef042833cba 2023-07-12 13:15:19,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712b587a16d2cdb4a8fad8654cd7f050264 2023-07-12 13:15:19,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712fa1b52251707413bb85d488e61c4678c 2023-07-12 13:15:19,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307121cf5ae7f706048c4bd6f2d3abbaa6c5d 2023-07-12 13:15:19,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712a8300da1f2cd4b4186d4bccd666e2d8b 2023-07-12 13:15:19,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712ca44b32066aa42c5896aaa0d7733c3ef 2023-07-12 13:15:19,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712d963b36ae7e441389a23a318f69a695d 2023-07-12 13:15:19,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1689167718518 2023-07-12 13:15:19,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.hbase-snapshot/.tmp/snaptb-1689167718518 2023-07-12 13:15:19,672 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 13:15:19,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-12 13:15:19,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-12 13:15:19,674 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-12 13:15:19,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.hbase-snapshot/.tmp/snaptb-1689167718518 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.hbase-snapshot/snaptb-1689167718518 2023-07-12 13:15:20,674 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 13:15:20,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-12 13:15:20,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-12 13:15:20,677 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-07-12 13:15:20,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1689167718518 of table testCompactionWithHFileLink completed 2023-07-12 13:15:20,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.hbase-snapshot/.tmp/snaptb-1689167718518 2023-07-12 13:15:20,712 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.hbase-snapshot/.tmp/snaptb-1689167718518 2023-07-12 13:15:20,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1689167718518 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1689167718554Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1689167719432 (+878 ms)Consolidate snapshot: snaptb-1689167718518 at 1689167719432Loading Region manifests for snaptb-1689167718518 at 1689167719433 (+1 ms)Writing data manifest for snaptb-1689167718518 at 1689167719444 (+11 ms)Verifying snapshot: snaptb-1689167718518 at 1689167719857 (+413 ms)Snapshot snaptb-1689167718518 of table testCompactionWithHFileLink completed at 1689167720710 (+853 ms) 2023-07-12 13:15:20,715 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-07-12 13:15:20,718 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.1590 sec 2023-07-12 13:15:22,677 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 13:15:22,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-12 13:15:22,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 13:15:22,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:15:22,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-07-12 13:15:22,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-12 13:15:22,721 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-12 13:15:22,721 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:22,721 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-12 13:15:22,721 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-12 13:15:22,721 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:22,721 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:22,722 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:22,722 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:22,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:22,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:22,722 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:22,722 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:15:22,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:22,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:22,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:15:22,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:22,723 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-12 13:15:22,723 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-07-12 13:15:22,723 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-12 13:15:22,723 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-12 13:15:22,723 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:22,723 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-12 13:15:22,723 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:22,724 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. started... 2023-07-12 13:15:22,724 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:22,724 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. started... 2023-07-12 13:15:22,724 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:22,724 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9c3dd1c27a1a45c43f96b95fb3aa34b8 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-12 13:15:22,724 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:15:22,724 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:15:22,724 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. started... 2023-07-12 13:15:22,724 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 684e9c34724c737ee5eb5d368452e637 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-12 13:15:22,724 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c9662635c9aef48a82b6818321244591 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-12 13:15:23,572 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family1/cf74aed4b3794ebd9e3054f540d1f23f 2023-07-12 13:15:23,573 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family1/5cb0c84a44f54ae1889597d85ad4040f 2023-07-12 13:15:23,575 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family1/799ee25fd4f74ba39632cab68d282892 2023-07-12 13:15:23,582 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf74aed4b3794ebd9e3054f540d1f23f 2023-07-12 13:15:23,583 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5cb0c84a44f54ae1889597d85ad4040f 2023-07-12 13:15:23,583 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 799ee25fd4f74ba39632cab68d282892 2023-07-12 13:15:23,996 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family2/2877febd4323477d859a8717309c160f 2023-07-12 13:15:24,002 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2877febd4323477d859a8717309c160f 2023-07-12 13:15:24,003 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family1/799ee25fd4f74ba39632cab68d282892 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/799ee25fd4f74ba39632cab68d282892 2023-07-12 13:15:24,006 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 799ee25fd4f74ba39632cab68d282892 2023-07-12 13:15:24,006 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/799ee25fd4f74ba39632cab68d282892, entries=3, sequenceid=24, filesize=5.0 K 2023-07-12 13:15:24,006 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family2/2877febd4323477d859a8717309c160f as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/2877febd4323477d859a8717309c160f 2023-07-12 13:15:24,009 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2877febd4323477d859a8717309c160f 2023-07-12 13:15:24,010 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/2877febd4323477d859a8717309c160f, entries=1, sequenceid=24, filesize=5.0 K 2023-07-12 13:15:24,010 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9c3dd1c27a1a45c43f96b95fb3aa34b8 in 1286ms, sequenceid=24, compaction requested=true 2023-07-12 13:15:24,010 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:24,010 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:24,010 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:15:24,402 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family2/bf32d8f9be6a4365b78394a07d8d3ee1 2023-07-12 13:15:24,403 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family2/c813eea880104e17b55566db66efbb18 2023-07-12 13:15:24,409 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf32d8f9be6a4365b78394a07d8d3ee1 2023-07-12 13:15:24,410 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c813eea880104e17b55566db66efbb18 2023-07-12 13:15:24,411 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family1/5cb0c84a44f54ae1889597d85ad4040f as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/5cb0c84a44f54ae1889597d85ad4040f 2023-07-12 13:15:24,411 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family1/cf74aed4b3794ebd9e3054f540d1f23f as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/cf74aed4b3794ebd9e3054f540d1f23f 2023-07-12 13:15:24,416 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5cb0c84a44f54ae1889597d85ad4040f 2023-07-12 13:15:24,416 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/5cb0c84a44f54ae1889597d85ad4040f, entries=3, sequenceid=24, filesize=5.0 K 2023-07-12 13:15:24,416 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf74aed4b3794ebd9e3054f540d1f23f 2023-07-12 13:15:24,416 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/cf74aed4b3794ebd9e3054f540d1f23f, entries=3, sequenceid=24, filesize=5.0 K 2023-07-12 13:15:24,417 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family2/bf32d8f9be6a4365b78394a07d8d3ee1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/bf32d8f9be6a4365b78394a07d8d3ee1 2023-07-12 13:15:24,417 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family2/c813eea880104e17b55566db66efbb18 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/c813eea880104e17b55566db66efbb18 2023-07-12 13:15:24,422 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf32d8f9be6a4365b78394a07d8d3ee1 2023-07-12 13:15:24,422 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c813eea880104e17b55566db66efbb18 2023-07-12 13:15:24,422 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/bf32d8f9be6a4365b78394a07d8d3ee1, entries=1, sequenceid=24, filesize=5.0 K 2023-07-12 13:15:24,422 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/c813eea880104e17b55566db66efbb18, entries=1, sequenceid=24, filesize=5.0 K 2023-07-12 13:15:24,423 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 684e9c34724c737ee5eb5d368452e637 in 1699ms, sequenceid=24, compaction requested=true 2023-07-12 13:15:24,423 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c9662635c9aef48a82b6818321244591 in 1699ms, sequenceid=24, compaction requested=true 2023-07-12 13:15:24,423 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:24,423 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:24,423 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:24,423 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:24,423 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:15:24,423 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:15:24,423 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:15:24,423 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,424 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-12 13:15:24,424 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-12 13:15:24,426 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,426 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:24,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:24,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:24,426 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:24,426 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:15:24,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:24,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:24,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:24,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:24,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-12 13:15:24,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a25e5fd[Count = 0] remaining members to acquire global barrier 2023-07-12 13:15:24,428 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-12 13:15:24,428 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:24,429 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:24,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:24,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:24,429 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-12 13:15:24,429 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-12 13:15:24,429 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:15:24,429 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,429 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:15:24,430 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-12 13:15:24,430 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,430 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:24,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:24,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:24,430 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-12 13:15:24,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:24,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:24,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:24,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:24,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:24,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:15:24,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-12 13:15:24,433 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-12 13:15:24,433 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:15:24,433 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:15:24,433 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-12 13:15:24,433 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:15:24,435 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:24,435 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:24,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:24,435 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:24,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:24,435 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:24,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:24,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:24,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:24,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:24,437 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:24,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-12 13:15:24,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,438 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,438 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:24,438 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-12 13:15:24,438 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:24,438 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:24,438 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-12 13:15:24,438 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:24,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-07-12 13:15:24,438 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-12 13:15:24,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-12 13:15:24,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:15:24,438 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:24,439 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:24,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:24,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:24,439 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-12 13:15:24,439 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:15:24,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:24,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:24,539 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:15:24,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:15:24,667 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:15:24,667 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-07-12 13:15:24,668 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): 684e9c34724c737ee5eb5d368452e637/family1 is initiating major compaction (all files) 2023-07-12 13:15:24,668 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:15:24,668 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:15:24,668 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of 684e9c34724c737ee5eb5d368452e637/family1 in testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:24,669 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/ac3029b2ba8840569b178aa508e0ea97, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/04c0fd3198224028a40240310b5556a4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/fb5dcfa8cda6468c810a8804e8fcdad2, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/6139ff44e92a436c835fe1ada2e7d0dc, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/5cb0c84a44f54ae1889597d85ad4040f] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp, totalSize=26.7 K 2023-07-12 13:15:24,669 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting ac3029b2ba8840569b178aa508e0ea97, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167712040 2023-07-12 13:15:24,669 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 04c0fd3198224028a40240310b5556a4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167713890 2023-07-12 13:15:24,670 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting fb5dcfa8cda6468c810a8804e8fcdad2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167715692 2023-07-12 13:15:24,670 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 6139ff44e92a436c835fe1ada2e7d0dc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167717112 2023-07-12 13:15:24,670 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 5cb0c84a44f54ae1889597d85ad4040f, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-12 13:15:24,686 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): 684e9c34724c737ee5eb5d368452e637#family1#compaction#108 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:25,096 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202307125d0f1332dc294d33b5e3ea7d55518534_del 2023-07-12 13:15:25,096 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307125d0f1332dc294d33b5e3ea7d55518534_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307125d0f1332dc294d33b5e3ea7d55518534_del 2023-07-12 13:15:25,919 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cc87b8045ec7494c8116ca4f80c150e9 2023-07-12 13:15:25,921 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family1/cc87b8045ec7494c8116ca4f80c150e9 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/cc87b8045ec7494c8116ca4f80c150e9 2023-07-12 13:15:25,926 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cc87b8045ec7494c8116ca4f80c150e9 2023-07-12 13:15:25,927 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 684e9c34724c737ee5eb5d368452e637/family1 of 684e9c34724c737ee5eb5d368452e637 into cc87b8045ec7494c8116ca4f80c150e9(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:15:25,927 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:25,927 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:15:25,927 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): 684e9c34724c737ee5eb5d368452e637/family2 is initiating major compaction (all files) 2023-07-12 13:15:25,927 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:15:25,927 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:15:25,927 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of 684e9c34724c737ee5eb5d368452e637/family2 in testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:25,928 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/e360b016c292406c9af549f09c05cf50, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/1a646d40dbb346f29d1105dfa4bf26d4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/becbb35b762347e9a93052b8104401a9, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/9edbf3c966d24513a206c3a825c590d1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/bf32d8f9be6a4365b78394a07d8d3ee1] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp, totalSize=25.4 K 2023-07-12 13:15:25,928 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting e360b016c292406c9af549f09c05cf50, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167712040 2023-07-12 13:15:25,928 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 1a646d40dbb346f29d1105dfa4bf26d4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167713890 2023-07-12 13:15:25,929 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting becbb35b762347e9a93052b8104401a9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167715692 2023-07-12 13:15:25,929 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 9edbf3c966d24513a206c3a825c590d1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167717112 2023-07-12 13:15:25,929 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting bf32d8f9be6a4365b78394a07d8d3ee1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-12 13:15:25,940 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): 684e9c34724c737ee5eb5d368452e637#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:25,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/ac3029b2ba8840569b178aa508e0ea97, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/04c0fd3198224028a40240310b5556a4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/fb5dcfa8cda6468c810a8804e8fcdad2, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/6139ff44e92a436c835fe1ada2e7d0dc, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/5cb0c84a44f54ae1889597d85ad4040f] to archive 2023-07-12 13:15:25,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:25,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/ac3029b2ba8840569b178aa508e0ea97 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/ac3029b2ba8840569b178aa508e0ea97 2023-07-12 13:15:25,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/04c0fd3198224028a40240310b5556a4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/04c0fd3198224028a40240310b5556a4 2023-07-12 13:15:25,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/fb5dcfa8cda6468c810a8804e8fcdad2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/fb5dcfa8cda6468c810a8804e8fcdad2 2023-07-12 13:15:25,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/6139ff44e92a436c835fe1ada2e7d0dc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/6139ff44e92a436c835fe1ada2e7d0dc 2023-07-12 13:15:25,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/5cb0c84a44f54ae1889597d85ad4040f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/5cb0c84a44f54ae1889597d85ad4040f 2023-07-12 13:15:26,356 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202307126683d166e38148a4a493bfccfda20162_del 2023-07-12 13:15:26,356 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307126683d166e38148a4a493bfccfda20162_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307126683d166e38148a4a493bfccfda20162_del 2023-07-12 13:15:27,183 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 976c927a5bba47eebddceeddc31e03eb 2023-07-12 13:15:27,184 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family2/976c927a5bba47eebddceeddc31e03eb as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/976c927a5bba47eebddceeddc31e03eb 2023-07-12 13:15:27,192 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 976c927a5bba47eebddceeddc31e03eb 2023-07-12 13:15:27,193 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 684e9c34724c737ee5eb5d368452e637/family2 of 684e9c34724c737ee5eb5d368452e637 into 976c927a5bba47eebddceeddc31e03eb(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:15:27,194 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:27,194 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:15:27,194 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): 9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 is initiating major compaction (all files) 2023-07-12 13:15:27,194 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:15:27,194 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:15:27,194 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of 9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 in testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:27,194 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/2aa69aa56e324088b3e9ae8eb04f5204, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/058aa9a11dd54cc7941b7afb8f7de47b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/7127f07493ed4f5da2d22b562a0ea1ed, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/61ac1037c26741818a4ef3077263a14e, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/799ee25fd4f74ba39632cab68d282892] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp, totalSize=26.7 K 2023-07-12 13:15:27,195 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 2aa69aa56e324088b3e9ae8eb04f5204, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167712044 2023-07-12 13:15:27,195 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 058aa9a11dd54cc7941b7afb8f7de47b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167713890 2023-07-12 13:15:27,196 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 7127f07493ed4f5da2d22b562a0ea1ed, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167715693 2023-07-12 13:15:27,197 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 61ac1037c26741818a4ef3077263a14e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167717113 2023-07-12 13:15:27,197 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 799ee25fd4f74ba39632cab68d282892, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-12 13:15:27,213 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): 9c3dd1c27a1a45c43f96b95fb3aa34b8#family1#compaction#110 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:27,223 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230712a7fdd4725a25401ab92d779cf87ba1ff_del 2023-07-12 13:15:27,224 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712a7fdd4725a25401ab92d779cf87ba1ff_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230712a7fdd4725a25401ab92d779cf87ba1ff_del 2023-07-12 13:15:27,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/e360b016c292406c9af549f09c05cf50, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/1a646d40dbb346f29d1105dfa4bf26d4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/becbb35b762347e9a93052b8104401a9, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/9edbf3c966d24513a206c3a825c590d1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/bf32d8f9be6a4365b78394a07d8d3ee1] to archive 2023-07-12 13:15:27,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:27,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/e360b016c292406c9af549f09c05cf50 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/e360b016c292406c9af549f09c05cf50 2023-07-12 13:15:27,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/1a646d40dbb346f29d1105dfa4bf26d4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/1a646d40dbb346f29d1105dfa4bf26d4 2023-07-12 13:15:27,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/becbb35b762347e9a93052b8104401a9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/becbb35b762347e9a93052b8104401a9 2023-07-12 13:15:27,275 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/9edbf3c966d24513a206c3a825c590d1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/9edbf3c966d24513a206c3a825c590d1 2023-07-12 13:15:27,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/bf32d8f9be6a4365b78394a07d8d3ee1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/bf32d8f9be6a4365b78394a07d8d3ee1 2023-07-12 13:15:28,045 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d195026f8b6e4967a41972a247873ae8 2023-07-12 13:15:28,047 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family1/d195026f8b6e4967a41972a247873ae8 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/d195026f8b6e4967a41972a247873ae8 2023-07-12 13:15:28,054 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d195026f8b6e4967a41972a247873ae8 2023-07-12 13:15:28,054 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 of 9c3dd1c27a1a45c43f96b95fb3aa34b8 into d195026f8b6e4967a41972a247873ae8(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:15:28,055 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:28,055 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:15:28,055 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): 9c3dd1c27a1a45c43f96b95fb3aa34b8/family2 is initiating major compaction (all files) 2023-07-12 13:15:28,055 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:15:28,055 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:15:28,055 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of 9c3dd1c27a1a45c43f96b95fb3aa34b8/family2 in testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:28,055 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/9f940e710eea4544a0ea53b174ebee2b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/f1c8b53a8c0943b1a10cd93917fcfc1b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/8cffb17142ac4e04a69c8ae5d0ad3b2a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/e459491ae4344c89aefef7bff114515a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/2877febd4323477d859a8717309c160f] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp, totalSize=25.4 K 2023-07-12 13:15:28,055 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 9f940e710eea4544a0ea53b174ebee2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167712044 2023-07-12 13:15:28,056 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting f1c8b53a8c0943b1a10cd93917fcfc1b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167713890 2023-07-12 13:15:28,056 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 8cffb17142ac4e04a69c8ae5d0ad3b2a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167715693 2023-07-12 13:15:28,056 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting e459491ae4344c89aefef7bff114515a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167717113 2023-07-12 13:15:28,057 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 2877febd4323477d859a8717309c160f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-12 13:15:28,067 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): 9c3dd1c27a1a45c43f96b95fb3aa34b8#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:28,068 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/2aa69aa56e324088b3e9ae8eb04f5204, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/058aa9a11dd54cc7941b7afb8f7de47b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/7127f07493ed4f5da2d22b562a0ea1ed, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/61ac1037c26741818a4ef3077263a14e, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/799ee25fd4f74ba39632cab68d282892] to archive 2023-07-12 13:15:28,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:28,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/2aa69aa56e324088b3e9ae8eb04f5204 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/2aa69aa56e324088b3e9ae8eb04f5204 2023-07-12 13:15:28,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/058aa9a11dd54cc7941b7afb8f7de47b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/058aa9a11dd54cc7941b7afb8f7de47b 2023-07-12 13:15:28,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/7127f07493ed4f5da2d22b562a0ea1ed to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/7127f07493ed4f5da2d22b562a0ea1ed 2023-07-12 13:15:28,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/61ac1037c26741818a4ef3077263a14e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/61ac1037c26741818a4ef3077263a14e 2023-07-12 13:15:28,076 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230712fc85f79433fc4965836a51fef070679a_del 2023-07-12 13:15:28,076 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712fc85f79433fc4965836a51fef070679a_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712fc85f79433fc4965836a51fef070679a_del 2023-07-12 13:15:28,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/799ee25fd4f74ba39632cab68d282892 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/799ee25fd4f74ba39632cab68d282892 2023-07-12 13:15:28,907 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d80208c06e474f5a91a25c7fba5424bc 2023-07-12 13:15:28,909 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family2/d80208c06e474f5a91a25c7fba5424bc as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/d80208c06e474f5a91a25c7fba5424bc 2023-07-12 13:15:28,916 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d80208c06e474f5a91a25c7fba5424bc 2023-07-12 13:15:28,917 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9c3dd1c27a1a45c43f96b95fb3aa34b8/family2 of 9c3dd1c27a1a45c43f96b95fb3aa34b8 into d80208c06e474f5a91a25c7fba5424bc(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:15:28,917 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:28,917 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:15:28,917 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): c9662635c9aef48a82b6818321244591/family1 is initiating major compaction (all files) 2023-07-12 13:15:28,917 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:15:28,917 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:15:28,918 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of c9662635c9aef48a82b6818321244591/family1 in testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:28,918 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/98c96d9ec7164b0c9e4e2740144261e4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/67b7de58b2134506aa21b79c5ead4bb4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/add5584e719b4cd3ab22db193414bd4a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/8b96dfbdc0934784a142ee622c889b86, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/cf74aed4b3794ebd9e3054f540d1f23f] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp, totalSize=26.7 K 2023-07-12 13:15:28,918 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 98c96d9ec7164b0c9e4e2740144261e4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167712042 2023-07-12 13:15:28,919 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 67b7de58b2134506aa21b79c5ead4bb4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167713890 2023-07-12 13:15:28,920 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting add5584e719b4cd3ab22db193414bd4a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167715693 2023-07-12 13:15:28,920 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 8b96dfbdc0934784a142ee622c889b86, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167717113 2023-07-12 13:15:28,921 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting cf74aed4b3794ebd9e3054f540d1f23f, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-12 13:15:28,936 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): c9662635c9aef48a82b6818321244591#family1#compaction#112 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:28,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/9f940e710eea4544a0ea53b174ebee2b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/f1c8b53a8c0943b1a10cd93917fcfc1b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/8cffb17142ac4e04a69c8ae5d0ad3b2a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/e459491ae4344c89aefef7bff114515a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/2877febd4323477d859a8717309c160f] to archive 2023-07-12 13:15:28,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:28,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/9f940e710eea4544a0ea53b174ebee2b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/9f940e710eea4544a0ea53b174ebee2b 2023-07-12 13:15:28,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/f1c8b53a8c0943b1a10cd93917fcfc1b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/f1c8b53a8c0943b1a10cd93917fcfc1b 2023-07-12 13:15:28,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/8cffb17142ac4e04a69c8ae5d0ad3b2a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/8cffb17142ac4e04a69c8ae5d0ad3b2a 2023-07-12 13:15:28,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/e459491ae4344c89aefef7bff114515a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/e459491ae4344c89aefef7bff114515a 2023-07-12 13:15:28,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/2877febd4323477d859a8717309c160f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/2877febd4323477d859a8717309c160f 2023-07-12 13:15:29,350 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202307124b407ef676c646cba0547cb886b3c6b5_del 2023-07-12 13:15:29,351 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307124b407ef676c646cba0547cb886b3c6b5_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307124b407ef676c646cba0547cb886b3c6b5_del 2023-07-12 13:15:30,174 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 450d3a72e10640b1938617c9d3d8f0aa 2023-07-12 13:15:30,175 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family1/450d3a72e10640b1938617c9d3d8f0aa as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/450d3a72e10640b1938617c9d3d8f0aa 2023-07-12 13:15:30,183 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 450d3a72e10640b1938617c9d3d8f0aa 2023-07-12 13:15:30,184 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c9662635c9aef48a82b6818321244591/family1 of c9662635c9aef48a82b6818321244591 into 450d3a72e10640b1938617c9d3d8f0aa(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:15:30,184 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:30,184 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:15:30,184 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): c9662635c9aef48a82b6818321244591/family2 is initiating major compaction (all files) 2023-07-12 13:15:30,185 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:15:30,185 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:15:30,185 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of c9662635c9aef48a82b6818321244591/family2 in testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:30,185 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/dbe2d55ba4064942b00e7acd854624a3, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/b1bb4c69875342b583d1bb33bb5f0812, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/9b7a0e928eb043c6a64ccdcdcff789f1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/0cd811c0249f434e9a2e8af031613111, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/c813eea880104e17b55566db66efbb18] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp, totalSize=25.4 K 2023-07-12 13:15:30,186 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting dbe2d55ba4064942b00e7acd854624a3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167712042 2023-07-12 13:15:30,187 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting b1bb4c69875342b583d1bb33bb5f0812, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167713890 2023-07-12 13:15:30,187 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 9b7a0e928eb043c6a64ccdcdcff789f1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167715693 2023-07-12 13:15:30,188 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 0cd811c0249f434e9a2e8af031613111, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167717113 2023-07-12 13:15:30,188 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting c813eea880104e17b55566db66efbb18, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-12 13:15:30,201 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): c9662635c9aef48a82b6818321244591#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:30,273 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/98c96d9ec7164b0c9e4e2740144261e4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/67b7de58b2134506aa21b79c5ead4bb4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/add5584e719b4cd3ab22db193414bd4a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/8b96dfbdc0934784a142ee622c889b86, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/cf74aed4b3794ebd9e3054f540d1f23f] to archive 2023-07-12 13:15:30,275 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:30,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/98c96d9ec7164b0c9e4e2740144261e4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/98c96d9ec7164b0c9e4e2740144261e4 2023-07-12 13:15:30,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/67b7de58b2134506aa21b79c5ead4bb4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/67b7de58b2134506aa21b79c5ead4bb4 2023-07-12 13:15:30,286 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/add5584e719b4cd3ab22db193414bd4a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/add5584e719b4cd3ab22db193414bd4a 2023-07-12 13:15:30,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/8b96dfbdc0934784a142ee622c889b86 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/8b96dfbdc0934784a142ee622c889b86 2023-07-12 13:15:30,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/cf74aed4b3794ebd9e3054f540d1f23f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/cf74aed4b3794ebd9e3054f540d1f23f 2023-07-12 13:15:30,615 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023071204be1f4760d44932bbf75c83a5d91149_del 2023-07-12 13:15:30,615 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071204be1f4760d44932bbf75c83a5d91149_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071204be1f4760d44932bbf75c83a5d91149_del 2023-07-12 13:15:31,437 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 018a229cd5fb449288050fd7dbfe991b 2023-07-12 13:15:31,438 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family2/018a229cd5fb449288050fd7dbfe991b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/018a229cd5fb449288050fd7dbfe991b 2023-07-12 13:15:31,446 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 018a229cd5fb449288050fd7dbfe991b 2023-07-12 13:15:31,447 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c9662635c9aef48a82b6818321244591/family2 of c9662635c9aef48a82b6818321244591 into 018a229cd5fb449288050fd7dbfe991b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:15:31,447 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:31,453 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:31,457 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:31,463 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:31,465 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:31,473 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-12 13:15:31,477 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/dbe2d55ba4064942b00e7acd854624a3, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/b1bb4c69875342b583d1bb33bb5f0812, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/9b7a0e928eb043c6a64ccdcdcff789f1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/0cd811c0249f434e9a2e8af031613111, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/c813eea880104e17b55566db66efbb18] to archive 2023-07-12 13:15:31,477 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:31,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/dbe2d55ba4064942b00e7acd854624a3 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/dbe2d55ba4064942b00e7acd854624a3 2023-07-12 13:15:31,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/b1bb4c69875342b583d1bb33bb5f0812 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/b1bb4c69875342b583d1bb33bb5f0812 2023-07-12 13:15:31,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/9b7a0e928eb043c6a64ccdcdcff789f1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/9b7a0e928eb043c6a64ccdcdcff789f1 2023-07-12 13:15:31,482 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/0cd811c0249f434e9a2e8af031613111 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/0cd811c0249f434e9a2e8af031613111 2023-07-12 13:15:31,483 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/c813eea880104e17b55566db66efbb18 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/c813eea880104e17b55566db66efbb18 2023-07-12 13:15:31,511 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-07-12 13:15:31,515 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202307125d0f1332dc294d33b5e3ea7d55518534_del 2023-07-12 13:15:31,518 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202307124b407ef676c646cba0547cb886b3c6b5_del 2023-07-12 13:15:31,521 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230712a7fdd4725a25401ab92d779cf87ba1ff_del 2023-07-12 13:15:31,522 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:31,522 DEBUG [Listener at localhost.localdomain/44505] zookeeper.ReadOnlyZKClient(139): Connect 0x368a380b to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:15:31,527 DEBUG [Listener at localhost.localdomain/44505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a735ad9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:15:31,527 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230712 for table='testCompactionWithHFileLink' and column='family1' 2023-07-12 13:15:31,527 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230712 for table='testCompactionWithHFileLink' and column='family1' 2023-07-12 13:15:31,527 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230712 for table='testCompactionWithHFileLink' and column='family1' 2023-07-12 13:15:31,988 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712edb152b9ee71422b91ad1f64e225c11c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230712edb152b9ee71422b91ad1f64e225c11c 2023-07-12 13:15:31,989 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230712 table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:32,000 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:15:32,003 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:15:32,010 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:15:32,012 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:15:32,021 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230712/family1/3b1c382bbabe4242a99c41ed7ebe5bde first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-07-12 13:15:32,022 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230712/family1/3b1c382bbabe4242a99c41ed7ebe5bde}] 2023-07-12 13:15:32,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230712/family1/3b1c382bbabe4242a99c41ed7ebe5bde for inclusion in 9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 2023-07-12 13:15:32,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-07-12 13:15:32,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-12 13:15:32,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:32,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230712/family1/3b1c382bbabe4242a99c41ed7ebe5bde to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__sluercmjterca43p97avl6jcr5l2o8ns0tlpcatvb19u0uv7pmrgemu5epsvku3e/family1/3b1c382bbabe4242a99c41ed7ebe5bde 2023-07-12 13:15:32,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__sluercmjterca43p97avl6jcr5l2o8ns0tlpcatvb19u0uv7pmrgemu5epsvku3e/family1/3b1c382bbabe4242a99c41ed7ebe5bde as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/6ba3a5c88def4de6afc1c3f0029b7d27_SeqId_29_ 2023-07-12 13:15:32,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__sluercmjterca43p97avl6jcr5l2o8ns0tlpcatvb19u0uv7pmrgemu5epsvku3e/family1/3b1c382bbabe4242a99c41ed7ebe5bde into 9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/6ba3a5c88def4de6afc1c3f0029b7d27_SeqId_29_ - updating store file list. 2023-07-12 13:15:32,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/6ba3a5c88def4de6afc1c3f0029b7d27_SeqId_29_ into 9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 2023-07-12 13:15:32,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__sluercmjterca43p97avl6jcr5l2o8ns0tlpcatvb19u0uv7pmrgemu5epsvku3e/family1/3b1c382bbabe4242a99c41ed7ebe5bde into 9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/6ba3a5c88def4de6afc1c3f0029b7d27_SeqId_29_) 2023-07-12 13:15:32,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__sluercmjterca43p97avl6jcr5l2o8ns0tlpcatvb19u0uv7pmrgemu5epsvku3e/family1/3b1c382bbabe4242a99c41ed7ebe5bde 2023-07-12 13:15:32,044 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230712 table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:32,045 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:32,048 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307120941e4843624445ea426f7f9d1d3b7f1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307120941e4843624445ea426f7f9d1d3b7f1 2023-07-12 13:15:32,050 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307123176af7e6cf648028f20c159f6cbd3da to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307123176af7e6cf648028f20c159f6cbd3da 2023-07-12 13:15:32,051 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071245cdeff6f95d450785c963fbc1a8c753 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071245cdeff6f95d450785c963fbc1a8c753 2023-07-12 13:15:32,053 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230712871db3f5f2fd46998a2101e6c7bb7c28 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230712871db3f5f2fd46998a2101e6c7bb7c28 2023-07-12 13:15:32,053 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-12 13:15:32,053 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230712' 2023-07-12 13:15:32,053 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230712 for table='testCompactionWithHFileLink' and column='family1' 2023-07-12 13:15:32,398 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712e9e6876eb7b842a5b7c14c64adb151c1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712e9e6876eb7b842a5b7c14c64adb151c1 2023-07-12 13:15:32,398 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307126bc90920bef240d3ad9065f21ff72793 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307126bc90920bef240d3ad9065f21ff72793 2023-07-12 13:15:32,399 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230712 table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:32,399 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230712 table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:32,430 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230712/family1/1e038c7579044ee7a10d93df16138d06 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-07-12 13:15:32,430 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230712/family1/e2d6759be6394bd6bc5f3912a9ae8212 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-07-12 13:15:32,432 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230712/family1/1e038c7579044ee7a10d93df16138d06}] 2023-07-12 13:15:32,432 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230712/family1/e2d6759be6394bd6bc5f3912a9ae8212}] 2023-07-12 13:15:32,435 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230712/family1/1e038c7579044ee7a10d93df16138d06 for inclusion in c9662635c9aef48a82b6818321244591/family1 2023-07-12 13:15:32,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230712/family1/e2d6759be6394bd6bc5f3912a9ae8212 for inclusion in 684e9c34724c737ee5eb5d368452e637/family1 2023-07-12 13:15:32,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-07-12 13:15:32,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-07-12 13:15:32,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(777): Region bounds: first=1 last=2 2023-07-12 13:15:32,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last=1 2023-07-12 13:15:32,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:32,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:32,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230712/family1/e2d6759be6394bd6bc5f3912a9ae8212 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__n5tudod2fmgmb87vdha2be2t2mo845t6ldc9ut8mssjio3006kfa0cfh1ffi9e8g/family1/e2d6759be6394bd6bc5f3912a9ae8212 2023-07-12 13:15:32,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230712/family1/1e038c7579044ee7a10d93df16138d06 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__no7v58ehgviq3n87r06vgqc60g28fqe400o1ss54lf2vh8nduuptm5ekk6shkbvo/family1/1e038c7579044ee7a10d93df16138d06 2023-07-12 13:15:32,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__n5tudod2fmgmb87vdha2be2t2mo845t6ldc9ut8mssjio3006kfa0cfh1ffi9e8g/family1/e2d6759be6394bd6bc5f3912a9ae8212 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/bafa3a4c988c4bc8aad237cf6c4dc501_SeqId_29_ 2023-07-12 13:15:32,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__no7v58ehgviq3n87r06vgqc60g28fqe400o1ss54lf2vh8nduuptm5ekk6shkbvo/family1/1e038c7579044ee7a10d93df16138d06 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/aa846f95a61c4c22a6d654eb8ac3b106_SeqId_29_ 2023-07-12 13:15:32,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__n5tudod2fmgmb87vdha2be2t2mo845t6ldc9ut8mssjio3006kfa0cfh1ffi9e8g/family1/e2d6759be6394bd6bc5f3912a9ae8212 into 684e9c34724c737ee5eb5d368452e637/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/bafa3a4c988c4bc8aad237cf6c4dc501_SeqId_29_ - updating store file list. 2023-07-12 13:15:32,443 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__no7v58ehgviq3n87r06vgqc60g28fqe400o1ss54lf2vh8nduuptm5ekk6shkbvo/family1/1e038c7579044ee7a10d93df16138d06 into c9662635c9aef48a82b6818321244591/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/aa846f95a61c4c22a6d654eb8ac3b106_SeqId_29_ - updating store file list. 2023-07-12 13:15:32,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/bafa3a4c988c4bc8aad237cf6c4dc501_SeqId_29_ into 684e9c34724c737ee5eb5d368452e637/family1 2023-07-12 13:15:32,446 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/aa846f95a61c4c22a6d654eb8ac3b106_SeqId_29_ into c9662635c9aef48a82b6818321244591/family1 2023-07-12 13:15:32,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__n5tudod2fmgmb87vdha2be2t2mo845t6ldc9ut8mssjio3006kfa0cfh1ffi9e8g/family1/e2d6759be6394bd6bc5f3912a9ae8212 into 684e9c34724c737ee5eb5d368452e637/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/bafa3a4c988c4bc8aad237cf6c4dc501_SeqId_29_) 2023-07-12 13:15:32,446 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__no7v58ehgviq3n87r06vgqc60g28fqe400o1ss54lf2vh8nduuptm5ekk6shkbvo/family1/1e038c7579044ee7a10d93df16138d06 into c9662635c9aef48a82b6818321244591/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/aa846f95a61c4c22a6d654eb8ac3b106_SeqId_29_) 2023-07-12 13:15:32,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__n5tudod2fmgmb87vdha2be2t2mo845t6ldc9ut8mssjio3006kfa0cfh1ffi9e8g/family1/e2d6759be6394bd6bc5f3912a9ae8212 2023-07-12 13:15:32,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__no7v58ehgviq3n87r06vgqc60g28fqe400o1ss54lf2vh8nduuptm5ekk6shkbvo/family1/1e038c7579044ee7a10d93df16138d06 2023-07-12 13:15:32,447 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230712 table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:32,447 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230712 table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:32,448 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:32,448 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:32,449 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071287169779b97148ee9f3892d1e355d2b0 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071287169779b97148ee9f3892d1e355d2b0 2023-07-12 13:15:32,449 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071210e4d113160e4b619b13c7fb902e4140 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071210e4d113160e4b619b13c7fb902e4140 2023-07-12 13:15:32,451 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307128c746917627b42f58f61962d2d2b7b5a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307128c746917627b42f58f61962d2d2b7b5a 2023-07-12 13:15:32,451 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307125dec2e95a11f4647a869cce690c3a76a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307125dec2e95a11f4647a869cce690c3a76a 2023-07-12 13:15:32,452 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230712eb54a68ddba04ce78456026abc3bb59f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230712eb54a68ddba04ce78456026abc3bb59f 2023-07-12 13:15:32,452 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712900d4cd6d6eb42819a02679754927ecc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712900d4cd6d6eb42819a02679754927ecc 2023-07-12 13:15:32,453 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230712fe9d1084ca5b41a18a37f96c6efbdb0f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230712fe9d1084ca5b41a18a37f96c6efbdb0f 2023-07-12 13:15:32,453 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-12 13:15:32,453 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230712' 2023-07-12 13:15:32,453 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712efb92ae907634cb6a2f4e17a5a44fd86 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712efb92ae907634cb6a2f4e17a5a44fd86 2023-07-12 13:15:32,453 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-12 13:15:32,453 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230712' 2023-07-12 13:15:32,453 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230712 for table='testCompactionWithHFileLink' and column='family1' 2023-07-12 13:15:32,454 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230712 for table='testCompactionWithHFileLink' and column='family1' 2023-07-12 13:15:32,454 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:32,454 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-07-12 13:15:32,454 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307125d0f1332dc294d33b5e3ea7d55518534_del] 2023-07-12 13:15:32,454 DEBUG [Listener at localhost.localdomain/44505] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:32,456 DEBUG [Listener at localhost.localdomain/44505] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307125d0f1332dc294d33b5e3ea7d55518534_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307125d0f1332dc294d33b5e3ea7d55518534_del 2023-07-12 13:15:32,456 INFO [Listener at localhost.localdomain/44505] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-07-12 13:15:32,456 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307124b407ef676c646cba0547cb886b3c6b5_del] 2023-07-12 13:15:32,456 DEBUG [Listener at localhost.localdomain/44505] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:32,457 DEBUG [Listener at localhost.localdomain/44505] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307124b407ef676c646cba0547cb886b3c6b5_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307124b407ef676c646cba0547cb886b3c6b5_del 2023-07-12 13:15:32,457 INFO [Listener at localhost.localdomain/44505] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-07-12 13:15:32,457 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230712a7fdd4725a25401ab92d779cf87ba1ff_del] 2023-07-12 13:15:32,458 DEBUG [Listener at localhost.localdomain/44505] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:32,459 DEBUG [Listener at localhost.localdomain/44505] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230712a7fdd4725a25401ab92d779cf87ba1ff_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230712a7fdd4725a25401ab92d779cf87ba1ff_del 2023-07-12 13:15:32,459 INFO [Listener at localhost.localdomain/44505] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-07-12 13:15:32,462 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:32,464 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:32,467 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:32,468 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:32,473 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-07-12 13:15:32,474 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testCompactionWithHFileLink 2023-07-12 13:15:32,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-07-12 13:15:32,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-07-12 13:15:32,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167732476"}]},"ts":"1689167732476"} 2023-07-12 13:15:32,478 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-07-12 13:15:32,479 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-07-12 13:15:32,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=684e9c34724c737ee5eb5d368452e637, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9662635c9aef48a82b6818321244591, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c3dd1c27a1a45c43f96b95fb3aa34b8, UNASSIGN}] 2023-07-12 13:15:32,481 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c3dd1c27a1a45c43f96b95fb3aa34b8, UNASSIGN 2023-07-12 13:15:32,481 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9662635c9aef48a82b6818321244591, UNASSIGN 2023-07-12 13:15:32,481 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=684e9c34724c737ee5eb5d368452e637, UNASSIGN 2023-07-12 13:15:32,481 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=9c3dd1c27a1a45c43f96b95fb3aa34b8, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:32,481 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=c9662635c9aef48a82b6818321244591, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:32,481 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167732481"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167732481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167732481"}]},"ts":"1689167732481"} 2023-07-12 13:15:32,481 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=684e9c34724c737ee5eb5d368452e637, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:32,481 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689167732481"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167732481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167732481"}]},"ts":"1689167732481"} 2023-07-12 13:15:32,481 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167732481"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167732481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167732481"}]},"ts":"1689167732481"} 2023-07-12 13:15:32,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure 9c3dd1c27a1a45c43f96b95fb3aa34b8, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:32,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure c9662635c9aef48a82b6818321244591, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:32,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 684e9c34724c737ee5eb5d368452e637, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:32,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-07-12 13:15:32,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:32,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 9c3dd1c27a1a45c43f96b95fb3aa34b8, disabling compactions & flushes 2023-07-12 13:15:32,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:32,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:32,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. after waiting 0 ms 2023-07-12 13:15:32,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:32,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-07-12 13:15:32,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:32,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:32,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:32,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:32,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 684e9c34724c737ee5eb5d368452e637, disabling compactions & flushes 2023-07-12 13:15:32,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:32,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:32,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. after waiting 0 ms 2023-07-12 13:15:32,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:32,653 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=9c3dd1c27a1a45c43f96b95fb3aa34b8, regionState=CLOSED 2023-07-12 13:15:32,654 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167732653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167732653"}]},"ts":"1689167732653"} 2023-07-12 13:15:32,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=91 2023-07-12 13:15:32,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure 9c3dd1c27a1a45c43f96b95fb3aa34b8, server=jenkins-hbase17.apache.org,41721,1689167613545 in 174 msec 2023-07-12 13:15:32,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-07-12 13:15:32,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c3dd1c27a1a45c43f96b95fb3aa34b8, UNASSIGN in 180 msec 2023-07-12 13:15:32,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:32,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:32,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:32,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close c9662635c9aef48a82b6818321244591 2023-07-12 13:15:32,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing c9662635c9aef48a82b6818321244591, disabling compactions & flushes 2023-07-12 13:15:32,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:32,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:32,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. after waiting 0 ms 2023-07-12 13:15:32,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:32,664 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=684e9c34724c737ee5eb5d368452e637, regionState=CLOSED 2023-07-12 13:15:32,664 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167732664"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167732664"}]},"ts":"1689167732664"} 2023-07-12 13:15:32,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=89 2023-07-12 13:15:32,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure 684e9c34724c737ee5eb5d368452e637, server=jenkins-hbase17.apache.org,41721,1689167613545 in 183 msec 2023-07-12 13:15:32,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=684e9c34724c737ee5eb5d368452e637, UNASSIGN in 189 msec 2023-07-12 13:15:32,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-07-12 13:15:32,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:32,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:32,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed c9662635c9aef48a82b6818321244591 2023-07-12 13:15:32,673 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=c9662635c9aef48a82b6818321244591, regionState=CLOSED 2023-07-12 13:15:32,673 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689167732673"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167732673"}]},"ts":"1689167732673"} 2023-07-12 13:15:32,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=90 2023-07-12 13:15:32,677 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure c9662635c9aef48a82b6818321244591, server=jenkins-hbase17.apache.org,41721,1689167613545 in 192 msec 2023-07-12 13:15:32,678 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=90, resume processing ppid=88 2023-07-12 13:15:32,678 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9662635c9aef48a82b6818321244591, UNASSIGN in 198 msec 2023-07-12 13:15:32,679 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167732679"}]},"ts":"1689167732679"} 2023-07-12 13:15:32,680 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-07-12 13:15:32,682 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-07-12 13:15:32,684 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 208 msec 2023-07-12 13:15:32,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-07-12 13:15:32,781 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-07-12 13:15:32,798 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1689167718518-1689167732798 2023-07-12 13:15:32,799 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-12 13:15:32,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689167732799 (current time:1689167732799). 2023-07-12 13:15:32,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 13:15:32,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] zookeeper.ReadOnlyZKClient(139): Connect 0x06f56b61 to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:15:32,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24ded3dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:15:32,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:15:32,806 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:15:32,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06f56b61 to 127.0.0.1:51470 2023-07-12 13:15:32,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:15:32,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 13:15:32,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-12 13:15:32,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-12 13:15:32,811 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-12 13:15:32,812 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1689168332812 2023-07-12 13:15:32,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-12 13:15:32,812 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1689167718518-1689167732798 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-07-12 13:15:32,812 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-07-12 13:15:32,812 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 13:15:32,913 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 13:15:32,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-12 13:15:32,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-12 13:15:32,917 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 13:15:33,117 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 13:15:33,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-12 13:15:33,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-12 13:15:33,121 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 13:15:33,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-07-12 13:15:33,221 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-07-12 13:15:33,221 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-07-12 13:15:33,221 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-07-12 13:15:33,222 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-07-12 13:15:33,222 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-07-12 13:15:33,222 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-07-12 13:15:33,222 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-07-12 13:15:33,222 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-07-12 13:15:33,225 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/6ba3a5c88def4de6afc1c3f0029b7d27_SeqId_29_, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/d195026f8b6e4967a41972a247873ae8] hfiles 2023-07-12 13:15:33,225 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/bafa3a4c988c4bc8aad237cf6c4dc501_SeqId_29_, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/cc87b8045ec7494c8116ca4f80c150e9] hfiles 2023-07-12 13:15:33,225 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/450d3a72e10640b1938617c9d3d8f0aa, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/aa846f95a61c4c22a6d654eb8ac3b106_SeqId_29_] hfiles 2023-07-12 13:15:33,225 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/6ba3a5c88def4de6afc1c3f0029b7d27_SeqId_29_ 2023-07-12 13:15:33,225 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712e9e6876eb7b842a5b7c14c64adb151c1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230712edb152b9ee71422b91ad1f64e225c11c, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307126bc90920bef240d3ad9065f21ff72793] hfiles 2023-07-12 13:15:33,225 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/d195026f8b6e4967a41972a247873ae8 2023-07-12 13:15:33,225 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/450d3a72e10640b1938617c9d3d8f0aa 2023-07-12 13:15:33,225 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/bafa3a4c988c4bc8aad237cf6c4dc501_SeqId_29_ 2023-07-12 13:15:33,225 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/aa846f95a61c4c22a6d654eb8ac3b106_SeqId_29_ 2023-07-12 13:15:33,225 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712e9e6876eb7b842a5b7c14c64adb151c1 2023-07-12 13:15:33,225 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/cc87b8045ec7494c8116ca4f80c150e9 2023-07-12 13:15:33,226 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230712edb152b9ee71422b91ad1f64e225c11c 2023-07-12 13:15:33,226 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307126bc90920bef240d3ad9065f21ff72793 2023-07-12 13:15:33,226 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/d80208c06e474f5a91a25c7fba5424bc] hfiles 2023-07-12 13:15:33,226 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/d80208c06e474f5a91a25c7fba5424bc 2023-07-12 13:15:33,226 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/976c927a5bba47eebddceeddc31e03eb] hfiles 2023-07-12 13:15:33,227 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/976c927a5bba47eebddceeddc31e03eb 2023-07-12 13:15:33,227 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/018a229cd5fb449288050fd7dbfe991b] hfiles 2023-07-12 13:15:33,227 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/018a229cd5fb449288050fd7dbfe991b 2023-07-12 13:15:33,232 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071204be1f4760d44932bbf75c83a5d91149_del, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307120fa552a4181747fa992ac3bb48194855, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712194bb5d6ee05477a980962d19dcee939, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712bf963372f6fd495a9116d2b4d7cee949, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712c4f0c4cee5ad4e53a0dac52b7ab420c2, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307120a481f0d5cdc42ef8725cf3fcc81f195, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071261d4b3e7233744fd80b4cef042833cba, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712b587a16d2cdb4a8fad8654cd7f050264, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712fa1b52251707413bb85d488e61c4678c, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712fc85f79433fc4965836a51fef070679a_del, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307121cf5ae7f706048c4bd6f2d3abbaa6c5d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307126683d166e38148a4a493bfccfda20162_del, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712a8300da1f2cd4b4186d4bccd666e2d8b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712ca44b32066aa42c5896aaa0d7733c3ef, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712d963b36ae7e441389a23a318f69a695d] hfiles 2023-07-12 13:15:33,232 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071204be1f4760d44932bbf75c83a5d91149_del 2023-07-12 13:15:33,232 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307120fa552a4181747fa992ac3bb48194855 2023-07-12 13:15:33,232 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712194bb5d6ee05477a980962d19dcee939 2023-07-12 13:15:33,233 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712bf963372f6fd495a9116d2b4d7cee949 2023-07-12 13:15:33,233 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230712c4f0c4cee5ad4e53a0dac52b7ab420c2 2023-07-12 13:15:33,233 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307120a481f0d5cdc42ef8725cf3fcc81f195 2023-07-12 13:15:33,233 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071261d4b3e7233744fd80b4cef042833cba 2023-07-12 13:15:33,233 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712b587a16d2cdb4a8fad8654cd7f050264 2023-07-12 13:15:33,233 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712fa1b52251707413bb85d488e61c4678c 2023-07-12 13:15:33,233 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712fc85f79433fc4965836a51fef070679a_del 2023-07-12 13:15:33,233 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307121cf5ae7f706048c4bd6f2d3abbaa6c5d 2023-07-12 13:15:33,233 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307126683d166e38148a4a493bfccfda20162_del 2023-07-12 13:15:33,233 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712a8300da1f2cd4b4186d4bccd666e2d8b 2023-07-12 13:15:33,233 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712ca44b32066aa42c5896aaa0d7733c3ef 2023-07-12 13:15:33,233 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230712d963b36ae7e441389a23a318f69a695d 2023-07-12 13:15:33,421 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 13:15:33,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-12 13:15:33,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-12 13:15:33,424 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 13:15:33,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-07-12 13:15:33,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1689167718518-1689167732798 2023-07-12 13:15:33,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1689167718518-1689167732798 2023-07-12 13:15:33,925 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 13:15:33,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-12 13:15:33,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-12 13:15:33,928 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-12 13:15:34,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1689167718518-1689167732798 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.hbase-snapshot/hbase-failsafe-snaptb-1689167718518-1689167732798 2023-07-12 13:15:34,901 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1689167718518-1689167732798 of table testCompactionWithHFileLink completed 2023-07-12 13:15:34,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1689167718518-1689167732798 2023-07-12 13:15:34,903 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1689167718518-1689167732798 2023-07-12 13:15:34,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1689167718518-1689167732798 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1689167732812Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1689167733220 (+408 ms)Consolidate snapshot: hbase-failsafe-snaptb-1689167718518-1689167732798 at 1689167733638 (+418 ms)Loading Region manifests for hbase-failsafe-snaptb-1689167718518-1689167732798 at 1689167733638Writing data manifest for hbase-failsafe-snaptb-1689167718518-1689167732798 at 1689167733645 (+7 ms)Verifying snapshot: hbase-failsafe-snaptb-1689167718518-1689167732798 at 1689167734055 (+410 ms)Snapshot hbase-failsafe-snaptb-1689167718518-1689167732798 of table testCompactionWithHFileLink completed at 1689167734901 (+846 ms) 2023-07-12 13:15:34,906 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-12 13:15:34,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.0960 sec 2023-07-12 13:15:34,928 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 13:15:34,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-12 13:15:34,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1689167718518-1689167732798 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 13:15:34,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1689167718518" table: "testCompactionWithHFileLink" creation_time: 1689167718529 type: FLUSH version: 2 ttl: 0 ) 2023-07-12 13:15:34,971 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1689167718518 as table=testCompactionWithHFileLink 2023-07-12 13:15:34,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-12 13:15:35,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-12 13:15:35,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-12 13:15:35,385 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-07-12 13:15:35,387 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-07-12 13:15:35,388 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-07-12 13:15:35,390 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-12 13:15:35,395 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1689167718518" table: "testCompactionWithHFileLink" creation_time: 1689167718529 type: FLUSH version: 2 ttl: 0 2023-07-12 13:15:35,396 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink 2023-07-12 13:15:35,401 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-07-12 13:15:35,405 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712e9e6876eb7b842a5b7c14c64adb151c1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230712e9e6876eb7b842a5b7c14c64adb151c1 2023-07-12 13:15:35,407 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307126bc90920bef240d3ad9065f21ff72793 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307126bc90920bef240d3ad9065f21ff72793 2023-07-12 13:15:35,408 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230712edb152b9ee71422b91ad1f64e225c11c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230712edb152b9ee71422b91ad1f64e225c11c 2023-07-12 13:15:35,408 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023071210e4d113160e4b619b13c7fb902e4140 of snapshot=snaptb-1689167718518 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-12 13:15:35,411 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202307125dec2e95a11f4647a869cce690c3a76a of snapshot=snaptb-1689167718518 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-12 13:15:35,415 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230712900d4cd6d6eb42819a02679754927ecc of snapshot=snaptb-1689167718518 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-12 13:15:35,419 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230712efb92ae907634cb6a2f4e17a5a44fd86 of snapshot=snaptb-1689167718518 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-12 13:15:35,423 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202307120941e4843624445ea426f7f9d1d3b7f1 of snapshot=snaptb-1689167718518 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-12 13:15:35,427 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202307123176af7e6cf648028f20c159f6cbd3da of snapshot=snaptb-1689167718518 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-12 13:15:35,430 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023071245cdeff6f95d450785c963fbc1a8c753 of snapshot=snaptb-1689167718518 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-12 13:15:35,432 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230712871db3f5f2fd46998a2101e6c7bb7c28 of snapshot=snaptb-1689167718518 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-12 13:15:35,434 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023071287169779b97148ee9f3892d1e355d2b0 of snapshot=snaptb-1689167718518 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-12 13:15:35,436 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202307128c746917627b42f58f61962d2d2b7b5a of snapshot=snaptb-1689167718518 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-12 13:15:35,442 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230712eb54a68ddba04ce78456026abc3bb59f of snapshot=snaptb-1689167718518 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-12 13:15:35,445 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230712fe9d1084ca5b41a18a37f96c6efbdb0f of snapshot=snaptb-1689167718518 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-12 13:15:35,450 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071204be1f4760d44932bbf75c83a5d91149_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071204be1f4760d44932bbf75c83a5d91149_del 2023-07-12 13:15:35,451 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307126683d166e38148a4a493bfccfda20162_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307126683d166e38148a4a493bfccfda20162_del 2023-07-12 13:15:35,452 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712fc85f79433fc4965836a51fef070679a_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230712fc85f79433fc4965836a51fef070679a_del 2023-07-12 13:15:35,452 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:35,452 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:35,452 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: c9662635c9aef48a82b6818321244591 2023-07-12 13:15:35,455 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/cc87b8045ec7494c8116ca4f80c150e9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/cc87b8045ec7494c8116ca4f80c150e9 2023-07-12 13:15:35,455 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/450d3a72e10640b1938617c9d3d8f0aa to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/450d3a72e10640b1938617c9d3d8f0aa 2023-07-12 13:15:35,455 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/6ba3a5c88def4de6afc1c3f0029b7d27_SeqId_29_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/6ba3a5c88def4de6afc1c3f0029b7d27_SeqId_29_ 2023-07-12 13:15:35,456 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/bafa3a4c988c4bc8aad237cf6c4dc501_SeqId_29_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/bafa3a4c988c4bc8aad237cf6c4dc501_SeqId_29_ 2023-07-12 13:15:35,456 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ac3029b2ba8840569b178aa508e0ea97 of snapshot=snaptb-1689167718518 to region=684e9c34724c737ee5eb5d368452e637 table=testCompactionWithHFileLink 2023-07-12 13:15:35,456 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/aa846f95a61c4c22a6d654eb8ac3b106_SeqId_29_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/aa846f95a61c4c22a6d654eb8ac3b106_SeqId_29_ 2023-07-12 13:15:35,456 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 98c96d9ec7164b0c9e4e2740144261e4 of snapshot=snaptb-1689167718518 to region=c9662635c9aef48a82b6818321244591 table=testCompactionWithHFileLink 2023-07-12 13:15:35,456 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/d195026f8b6e4967a41972a247873ae8 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/d195026f8b6e4967a41972a247873ae8 2023-07-12 13:15:35,456 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2aa69aa56e324088b3e9ae8eb04f5204 of snapshot=snaptb-1689167718518 to region=9c3dd1c27a1a45c43f96b95fb3aa34b8 table=testCompactionWithHFileLink 2023-07-12 13:15:35,459 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 04c0fd3198224028a40240310b5556a4 of snapshot=snaptb-1689167718518 to region=684e9c34724c737ee5eb5d368452e637 table=testCompactionWithHFileLink 2023-07-12 13:15:35,459 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 67b7de58b2134506aa21b79c5ead4bb4 of snapshot=snaptb-1689167718518 to region=c9662635c9aef48a82b6818321244591 table=testCompactionWithHFileLink 2023-07-12 13:15:35,459 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 058aa9a11dd54cc7941b7afb8f7de47b of snapshot=snaptb-1689167718518 to region=9c3dd1c27a1a45c43f96b95fb3aa34b8 table=testCompactionWithHFileLink 2023-07-12 13:15:35,462 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fb5dcfa8cda6468c810a8804e8fcdad2 of snapshot=snaptb-1689167718518 to region=684e9c34724c737ee5eb5d368452e637 table=testCompactionWithHFileLink 2023-07-12 13:15:35,462 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink add5584e719b4cd3ab22db193414bd4a of snapshot=snaptb-1689167718518 to region=c9662635c9aef48a82b6818321244591 table=testCompactionWithHFileLink 2023-07-12 13:15:35,462 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7127f07493ed4f5da2d22b562a0ea1ed of snapshot=snaptb-1689167718518 to region=9c3dd1c27a1a45c43f96b95fb3aa34b8 table=testCompactionWithHFileLink 2023-07-12 13:15:35,464 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6139ff44e92a436c835fe1ada2e7d0dc of snapshot=snaptb-1689167718518 to region=684e9c34724c737ee5eb5d368452e637 table=testCompactionWithHFileLink 2023-07-12 13:15:35,465 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8b96dfbdc0934784a142ee622c889b86 of snapshot=snaptb-1689167718518 to region=c9662635c9aef48a82b6818321244591 table=testCompactionWithHFileLink 2023-07-12 13:15:35,465 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 61ac1037c26741818a4ef3077263a14e of snapshot=snaptb-1689167718518 to region=9c3dd1c27a1a45c43f96b95fb3aa34b8 table=testCompactionWithHFileLink 2023-07-12 13:15:35,468 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/976c927a5bba47eebddceeddc31e03eb to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/976c927a5bba47eebddceeddc31e03eb 2023-07-12 13:15:35,468 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e360b016c292406c9af549f09c05cf50 of snapshot=snaptb-1689167718518 to region=684e9c34724c737ee5eb5d368452e637 table=testCompactionWithHFileLink 2023-07-12 13:15:35,468 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/018a229cd5fb449288050fd7dbfe991b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/018a229cd5fb449288050fd7dbfe991b 2023-07-12 13:15:35,468 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink dbe2d55ba4064942b00e7acd854624a3 of snapshot=snaptb-1689167718518 to region=c9662635c9aef48a82b6818321244591 table=testCompactionWithHFileLink 2023-07-12 13:15:35,469 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/d80208c06e474f5a91a25c7fba5424bc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/d80208c06e474f5a91a25c7fba5424bc 2023-07-12 13:15:35,469 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9f940e710eea4544a0ea53b174ebee2b of snapshot=snaptb-1689167718518 to region=9c3dd1c27a1a45c43f96b95fb3aa34b8 table=testCompactionWithHFileLink 2023-07-12 13:15:35,471 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1a646d40dbb346f29d1105dfa4bf26d4 of snapshot=snaptb-1689167718518 to region=684e9c34724c737ee5eb5d368452e637 table=testCompactionWithHFileLink 2023-07-12 13:15:35,471 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b1bb4c69875342b583d1bb33bb5f0812 of snapshot=snaptb-1689167718518 to region=c9662635c9aef48a82b6818321244591 table=testCompactionWithHFileLink 2023-07-12 13:15:35,472 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f1c8b53a8c0943b1a10cd93917fcfc1b of snapshot=snaptb-1689167718518 to region=9c3dd1c27a1a45c43f96b95fb3aa34b8 table=testCompactionWithHFileLink 2023-07-12 13:15:35,474 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink becbb35b762347e9a93052b8104401a9 of snapshot=snaptb-1689167718518 to region=684e9c34724c737ee5eb5d368452e637 table=testCompactionWithHFileLink 2023-07-12 13:15:35,474 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9b7a0e928eb043c6a64ccdcdcff789f1 of snapshot=snaptb-1689167718518 to region=c9662635c9aef48a82b6818321244591 table=testCompactionWithHFileLink 2023-07-12 13:15:35,474 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8cffb17142ac4e04a69c8ae5d0ad3b2a of snapshot=snaptb-1689167718518 to region=9c3dd1c27a1a45c43f96b95fb3aa34b8 table=testCompactionWithHFileLink 2023-07-12 13:15:35,477 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9edbf3c966d24513a206c3a825c590d1 of snapshot=snaptb-1689167718518 to region=684e9c34724c737ee5eb5d368452e637 table=testCompactionWithHFileLink 2023-07-12 13:15:35,477 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0cd811c0249f434e9a2e8af031613111 of snapshot=snaptb-1689167718518 to region=c9662635c9aef48a82b6818321244591 table=testCompactionWithHFileLink 2023-07-12 13:15:35,477 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e459491ae4344c89aefef7bff114515a of snapshot=snaptb-1689167718518 to region=9c3dd1c27a1a45c43f96b95fb3aa34b8 table=testCompactionWithHFileLink 2023-07-12 13:15:35,480 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1689167718518" table: "testCompactionWithHFileLink" creation_time: 1689167718529 type: FLUSH version: 2 ttl: 0 2023-07-12 13:15:35,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689167735481"}]},"ts":"9223372036854775807"} 2023-07-12 13:15:35,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689167735481"}]},"ts":"9223372036854775807"} 2023-07-12 13:15:35,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689167735481"}]},"ts":"9223372036854775807"} 2023-07-12 13:15:35,483 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-12 13:15:35,483 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 684e9c34724c737ee5eb5d368452e637, NAME => 'testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9c3dd1c27a1a45c43f96b95fb3aa34b8, NAME => 'testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => c9662635c9aef48a82b6818321244591, NAME => 'testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.', STARTKEY => '1', ENDKEY => '2'}] 2023-07-12 13:15:35,484 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167735482"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167735482"}]},"ts":"1689167735482"} 2023-07-12 13:15:35,484 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167735482"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167735482"}]},"ts":"1689167735482"} 2023-07-12 13:15:35,484 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689167735482"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167735482"}]},"ts":"1689167735482"} 2023-07-12 13:15:35,486 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-12 13:15:35,486 INFO [PEWorker-5] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-07-12 13:15:35,486 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 684e9c34724c737ee5eb5d368452e637, NAME => 'testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9c3dd1c27a1a45c43f96b95fb3aa34b8, NAME => 'testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => c9662635c9aef48a82b6818321244591, NAME => 'testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.', STARTKEY => '1', ENDKEY => '2'}] 2023-07-12 13:15:35,487 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1689167718518 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-07-12 13:15:35,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1689167718518" table: "testCompactionWithHFileLink" creation_time: 1689167718529 type: FLUSH version: 2 ttl: 0 ) in 524 msec 2023-07-12 13:15:35,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-12 13:15:35,581 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-07-12 13:15:35,581 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1689167718518-1689167732798 2023-07-12 13:15:35,591 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "hbase-failsafe-snaptb-1689167718518-1689167732798" 2023-07-12 13:15:35,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1689167718518-1689167732798 2023-07-12 13:15:35,595 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-07-12 13:15:35,598 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.HMaster$10(2385): Client=jenkins//136.243.18.41 enable testCompactionWithHFileLink 2023-07-12 13:15:35,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-07-12 13:15:35,605 INFO [PEWorker-2] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-07-12 13:15:35,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-12 13:15:35,605 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167735605"}]},"ts":"1689167735605"} 2023-07-12 13:15:35,606 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-07-12 13:15:35,609 DEBUG [PEWorker-2] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-07-12 13:15:35,609 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=684e9c34724c737ee5eb5d368452e637, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9662635c9aef48a82b6818321244591, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c3dd1c27a1a45c43f96b95fb3aa34b8, ASSIGN}] 2023-07-12 13:15:35,611 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c3dd1c27a1a45c43f96b95fb3aa34b8, ASSIGN 2023-07-12 13:15:35,611 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=684e9c34724c737ee5eb5d368452e637, ASSIGN 2023-07-12 13:15:35,611 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9662635c9aef48a82b6818321244591, ASSIGN 2023-07-12 13:15:35,611 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=684e9c34724c737ee5eb5d368452e637, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-07-12 13:15:35,611 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c3dd1c27a1a45c43f96b95fb3aa34b8, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-07-12 13:15:35,612 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9662635c9aef48a82b6818321244591, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-07-12 13:15:35,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-12 13:15:35,764 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=9c3dd1c27a1a45c43f96b95fb3aa34b8, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:35,764 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=684e9c34724c737ee5eb5d368452e637, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:35,764 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167735764"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167735764"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167735764"}]},"ts":"1689167735764"} 2023-07-12 13:15:35,764 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167735764"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167735764"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167735764"}]},"ts":"1689167735764"} 2023-07-12 13:15:35,764 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=c9662635c9aef48a82b6818321244591, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:35,765 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689167735764"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167735764"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167735764"}]},"ts":"1689167735764"} 2023-07-12 13:15:35,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure 9c3dd1c27a1a45c43f96b95fb3aa34b8, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:35,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure 684e9c34724c737ee5eb5d368452e637, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:35,769 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure c9662635c9aef48a82b6818321244591, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:35,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-12 13:15:35,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:35,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9c3dd1c27a1a45c43f96b95fb3aa34b8, NAME => 'testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 13:15:35,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:35,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:35,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:35,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:35,928 INFO [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:35,930 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 2023-07-12 13:15:35,930 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 2023-07-12 13:15:35,931 INFO [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c3dd1c27a1a45c43f96b95fb3aa34b8 columnFamilyName family1 2023-07-12 13:15:35,951 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-058aa9a11dd54cc7941b7afb8f7de47b 2023-07-12 13:15:35,957 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-2aa69aa56e324088b3e9ae8eb04f5204 2023-07-12 13:15:35,964 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-61ac1037c26741818a4ef3077263a14e 2023-07-12 13:15:35,972 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-7127f07493ed4f5da2d22b562a0ea1ed 2023-07-12 13:15:35,972 INFO [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(310): Store=9c3dd1c27a1a45c43f96b95fb3aa34b8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:35,973 INFO [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:35,974 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2 2023-07-12 13:15:35,974 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2 2023-07-12 13:15:35,975 INFO [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c3dd1c27a1a45c43f96b95fb3aa34b8 columnFamilyName family2 2023-07-12 13:15:35,985 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-8cffb17142ac4e04a69c8ae5d0ad3b2a 2023-07-12 13:15:35,990 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-9f940e710eea4544a0ea53b174ebee2b 2023-07-12 13:15:35,996 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-e459491ae4344c89aefef7bff114515a 2023-07-12 13:15:36,002 DEBUG [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-f1c8b53a8c0943b1a10cd93917fcfc1b 2023-07-12 13:15:36,002 INFO [StoreOpener-9c3dd1c27a1a45c43f96b95fb3aa34b8-1] regionserver.HStore(310): Store=9c3dd1c27a1a45c43f96b95fb3aa34b8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:36,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:36,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:36,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:15:36,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:15:36,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 9c3dd1c27a1a45c43f96b95fb3aa34b8; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61016173, jitterRate=-0.09078817069530487}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:15:36,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:36,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8., pid=101, masterSystemTime=1689167735920 2023-07-12 13:15:36,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:15:36,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-12 13:15:36,008 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-12 13:15:36,008 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-12 13:15:36,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:36,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:36,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:36,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c9662635c9aef48a82b6818321244591, NAME => 'testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.', STARTKEY => '1', ENDKEY => '2'} 2023-07-12 13:15:36,009 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=9c3dd1c27a1a45c43f96b95fb3aa34b8, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:36,009 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167736009"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167736009"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167736009"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167736009"}]},"ts":"1689167736009"} 2023-07-12 13:15:36,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c9662635c9aef48a82b6818321244591 2023-07-12 13:15:36,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:36,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for c9662635c9aef48a82b6818321244591 2023-07-12 13:15:36,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for c9662635c9aef48a82b6818321244591 2023-07-12 13:15:36,011 INFO [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c9662635c9aef48a82b6818321244591 2023-07-12 13:15:36,011 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-12 13:15:36,011 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1912): 9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 is initiating minor compaction (all files) 2023-07-12 13:15:36,011 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 in testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:36,011 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-2aa69aa56e324088b3e9ae8eb04f5204, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-058aa9a11dd54cc7941b7afb8f7de47b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-7127f07493ed4f5da2d22b562a0ea1ed, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-61ac1037c26741818a4ef3077263a14e] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp, totalSize=21.6 K 2023-07-12 13:15:36,011 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-12 13:15:36,011 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HStore(1912): 9c3dd1c27a1a45c43f96b95fb3aa34b8/family2 is initiating minor compaction (all files) 2023-07-12 13:15:36,011 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 9c3dd1c27a1a45c43f96b95fb3aa34b8/family2 in testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:15:36,011 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1 2023-07-12 13:15:36,011 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-9f940e710eea4544a0ea53b174ebee2b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-f1c8b53a8c0943b1a10cd93917fcfc1b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-8cffb17142ac4e04a69c8ae5d0ad3b2a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-e459491ae4344c89aefef7bff114515a] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp, totalSize=20.4 K 2023-07-12 13:15:36,012 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1 2023-07-12 13:15:36,012 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-2aa69aa56e324088b3e9ae8eb04f5204, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167712044 2023-07-12 13:15:36,012 INFO [StoreOpener-c9662635c9aef48a82b6818321244591-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9662635c9aef48a82b6818321244591 columnFamilyName family1 2023-07-12 13:15:36,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=100 2023-07-12 13:15:36,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure 9c3dd1c27a1a45c43f96b95fb3aa34b8, server=jenkins-hbase17.apache.org,41721,1689167613545 in 244 msec 2023-07-12 13:15:36,013 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-9f940e710eea4544a0ea53b174ebee2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167712044 2023-07-12 13:15:36,013 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-058aa9a11dd54cc7941b7afb8f7de47b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167713890 2023-07-12 13:15:36,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c3dd1c27a1a45c43f96b95fb3aa34b8, ASSIGN in 403 msec 2023-07-12 13:15:36,013 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-f1c8b53a8c0943b1a10cd93917fcfc1b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167713890 2023-07-12 13:15:36,013 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-7127f07493ed4f5da2d22b562a0ea1ed, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167715693 2023-07-12 13:15:36,014 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-8cffb17142ac4e04a69c8ae5d0ad3b2a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167715693 2023-07-12 13:15:36,014 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-61ac1037c26741818a4ef3077263a14e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167717113 2023-07-12 13:15:36,014 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-e459491ae4344c89aefef7bff114515a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167717113 2023-07-12 13:15:36,026 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-67b7de58b2134506aa21b79c5ead4bb4 2023-07-12 13:15:36,035 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-8b96dfbdc0934784a142ee622c889b86 2023-07-12 13:15:36,043 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-98c96d9ec7164b0c9e4e2740144261e4 2023-07-12 13:15:36,046 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9c3dd1c27a1a45c43f96b95fb3aa34b8#family1#compaction#115 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:36,052 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] throttle.PressureAwareThroughputController(145): 9c3dd1c27a1a45c43f96b95fb3aa34b8#family2#compaction#114 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:36,058 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-add5584e719b4cd3ab22db193414bd4a 2023-07-12 13:15:36,060 INFO [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(310): Store=c9662635c9aef48a82b6818321244591/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:36,061 INFO [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c9662635c9aef48a82b6818321244591 2023-07-12 13:15:36,061 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2 2023-07-12 13:15:36,062 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2 2023-07-12 13:15:36,062 INFO [StoreOpener-c9662635c9aef48a82b6818321244591-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9662635c9aef48a82b6818321244591 columnFamilyName family2 2023-07-12 13:15:36,073 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-0cd811c0249f434e9a2e8af031613111 2023-07-12 13:15:36,078 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-9b7a0e928eb043c6a64ccdcdcff789f1 2023-07-12 13:15:36,082 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-b1bb4c69875342b583d1bb33bb5f0812 2023-07-12 13:15:36,086 DEBUG [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-dbe2d55ba4064942b00e7acd854624a3 2023-07-12 13:15:36,086 INFO [StoreOpener-c9662635c9aef48a82b6818321244591-1] regionserver.HStore(310): Store=c9662635c9aef48a82b6818321244591/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:36,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591 2023-07-12 13:15:36,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591 2023-07-12 13:15:36,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:15:36,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for c9662635c9aef48a82b6818321244591 2023-07-12 13:15:36,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened c9662635c9aef48a82b6818321244591; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64848426, jitterRate=-0.03368315100669861}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:15:36,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:36,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591., pid=103, masterSystemTime=1689167735920 2023-07-12 13:15:36,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-12 13:15:36,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-07-12 13:15:36,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:36,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:36,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:36,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 684e9c34724c737ee5eb5d368452e637, NAME => 'testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 13:15:36,093 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=c9662635c9aef48a82b6818321244591, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:36,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:36,093 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689167736093"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167736093"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167736093"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167736093"}]},"ts":"1689167736093"} 2023-07-12 13:15:36,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:36,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:36,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:36,094 INFO [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:36,095 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1 2023-07-12 13:15:36,095 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1 2023-07-12 13:15:36,095 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=99 2023-07-12 13:15:36,095 INFO [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 684e9c34724c737ee5eb5d368452e637 columnFamilyName family1 2023-07-12 13:15:36,095 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure c9662635c9aef48a82b6818321244591, server=jenkins-hbase17.apache.org,41721,1689167613545 in 325 msec 2023-07-12 13:15:36,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9662635c9aef48a82b6818321244591, ASSIGN in 486 msec 2023-07-12 13:15:36,102 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-04c0fd3198224028a40240310b5556a4 2023-07-12 13:15:36,108 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-6139ff44e92a436c835fe1ada2e7d0dc 2023-07-12 13:15:36,114 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-ac3029b2ba8840569b178aa508e0ea97 2023-07-12 13:15:36,121 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-fb5dcfa8cda6468c810a8804e8fcdad2 2023-07-12 13:15:36,121 INFO [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(310): Store=684e9c34724c737ee5eb5d368452e637/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:36,122 INFO [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:36,123 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2 2023-07-12 13:15:36,123 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2 2023-07-12 13:15:36,123 INFO [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 684e9c34724c737ee5eb5d368452e637 columnFamilyName family2 2023-07-12 13:15:36,132 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-1a646d40dbb346f29d1105dfa4bf26d4 2023-07-12 13:15:36,139 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-9edbf3c966d24513a206c3a825c590d1 2023-07-12 13:15:36,144 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-becbb35b762347e9a93052b8104401a9 2023-07-12 13:15:36,150 DEBUG [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-e360b016c292406c9af549f09c05cf50 2023-07-12 13:15:36,151 INFO [StoreOpener-684e9c34724c737ee5eb5d368452e637-1] regionserver.HStore(310): Store=684e9c34724c737ee5eb5d368452e637/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:36,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:36,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:36,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:15:36,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:15:36,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 684e9c34724c737ee5eb5d368452e637; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72034789, jitterRate=0.07340200245380402}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:15:36,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:36,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637., pid=102, masterSystemTime=1689167735920 2023-07-12 13:15:36,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-07-12 13:15:36,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-07-12 13:15:36,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:36,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:36,159 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=684e9c34724c737ee5eb5d368452e637, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:36,159 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689167736159"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167736159"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167736159"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167736159"}]},"ts":"1689167736159"} 2023-07-12 13:15:36,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=98 2023-07-12 13:15:36,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure 684e9c34724c737ee5eb5d368452e637, server=jenkins-hbase17.apache.org,41721,1689167613545 in 392 msec 2023-07-12 13:15:36,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=98, resume processing ppid=97 2023-07-12 13:15:36,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=684e9c34724c737ee5eb5d368452e637, ASSIGN in 553 msec 2023-07-12 13:15:36,164 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167736163"}]},"ts":"1689167736163"} 2023-07-12 13:15:36,165 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-07-12 13:15:36,165 INFO [PEWorker-2] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-07-12 13:15:36,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 567 msec 2023-07-12 13:15:36,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-12 13:15:36,210 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-07-12 13:15:36,230 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:36,241 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:36,249 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:36,250 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:36,257 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-12 13:15:36,275 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-07-12 13:15:36,275 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:36,275 DEBUG [Listener at localhost.localdomain/44505] zookeeper.ReadOnlyZKClient(139): Connect 0x612e9a20 to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:15:36,280 DEBUG [Listener at localhost.localdomain/44505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e0804cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:15:36,280 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230712 for table='testCompactionWithHFileLink' and column='family1' 2023-07-12 13:15:36,280 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230712 for table='testCompactionWithHFileLink' and column='family1' 2023-07-12 13:15:36,280 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230712 for table='testCompactionWithHFileLink' and column='family1' 2023-07-12 13:15:36,767 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071231bbeb448baa47a9ae9c462b53c8b0c3 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071231bbeb448baa47a9ae9c462b53c8b0c3 2023-07-12 13:15:36,767 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307122ce74a8d6656492fb92cbdb5847b2775 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307122ce74a8d6656492fb92cbdb5847b2775 2023-07-12 13:15:36,768 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230712 table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:36,768 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230712 table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:36,780 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:15:36,784 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:15:36,790 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:15:36,793 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:15:36,806 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230712/family1/294563aeba2e46d78d84a6098885a37c first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-07-12 13:15:36,808 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230712/family1/294563aeba2e46d78d84a6098885a37c}] 2023-07-12 13:15:36,811 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230712/family1/ac5e7e1d066942609370d0b7ff255b4e first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-07-12 13:15:36,813 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230712/family1/ac5e7e1d066942609370d0b7ff255b4e}] 2023-07-12 13:15:36,816 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230712/family1/294563aeba2e46d78d84a6098885a37c for inclusion in c9662635c9aef48a82b6818321244591/family1 2023-07-12 13:15:36,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230712/family1/ac5e7e1d066942609370d0b7ff255b4e for inclusion in 9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 2023-07-12 13:15:36,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-07-12 13:15:36,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(777): Region bounds: first=1 last=2 2023-07-12 13:15:36,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-07-12 13:15:36,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-12 13:15:36,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:36,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:36,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230712/family1/294563aeba2e46d78d84a6098885a37c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__uj51h6ilo014uhql63hr3dq8f84md2kir4tdb0esla7k7e0psmpfnnkrvri8c8g8/family1/294563aeba2e46d78d84a6098885a37c 2023-07-12 13:15:36,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230712/family1/ac5e7e1d066942609370d0b7ff255b4e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__gius7idkmcq857carnp83ckoolk9jhll4rnqgte3e8544bjcse1559u9gn5fhbvo/family1/ac5e7e1d066942609370d0b7ff255b4e 2023-07-12 13:15:36,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__uj51h6ilo014uhql63hr3dq8f84md2kir4tdb0esla7k7e0psmpfnnkrvri8c8g8/family1/294563aeba2e46d78d84a6098885a37c as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/e82951e3b495467086ef498f248aeebd_SeqId_34_ 2023-07-12 13:15:36,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__gius7idkmcq857carnp83ckoolk9jhll4rnqgte3e8544bjcse1559u9gn5fhbvo/family1/ac5e7e1d066942609370d0b7ff255b4e as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/4841f85fd49a4b2e881acbbe0c6e2c62_SeqId_34_ 2023-07-12 13:15:36,822 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__uj51h6ilo014uhql63hr3dq8f84md2kir4tdb0esla7k7e0psmpfnnkrvri8c8g8/family1/294563aeba2e46d78d84a6098885a37c into c9662635c9aef48a82b6818321244591/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/e82951e3b495467086ef498f248aeebd_SeqId_34_ - updating store file list. 2023-07-12 13:15:36,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__gius7idkmcq857carnp83ckoolk9jhll4rnqgte3e8544bjcse1559u9gn5fhbvo/family1/ac5e7e1d066942609370d0b7ff255b4e into 9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/4841f85fd49a4b2e881acbbe0c6e2c62_SeqId_34_ - updating store file list. 2023-07-12 13:15:36,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/4841f85fd49a4b2e881acbbe0c6e2c62_SeqId_34_ into 9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 2023-07-12 13:15:36,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__gius7idkmcq857carnp83ckoolk9jhll4rnqgte3e8544bjcse1559u9gn5fhbvo/family1/ac5e7e1d066942609370d0b7ff255b4e into 9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/4841f85fd49a4b2e881acbbe0c6e2c62_SeqId_34_) 2023-07-12 13:15:36,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/e82951e3b495467086ef498f248aeebd_SeqId_34_ into c9662635c9aef48a82b6818321244591/family1 2023-07-12 13:15:36,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__uj51h6ilo014uhql63hr3dq8f84md2kir4tdb0esla7k7e0psmpfnnkrvri8c8g8/family1/294563aeba2e46d78d84a6098885a37c into c9662635c9aef48a82b6818321244591/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/e82951e3b495467086ef498f248aeebd_SeqId_34_) 2023-07-12 13:15:36,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__gius7idkmcq857carnp83ckoolk9jhll4rnqgte3e8544bjcse1559u9gn5fhbvo/family1/ac5e7e1d066942609370d0b7ff255b4e 2023-07-12 13:15:36,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__uj51h6ilo014uhql63hr3dq8f84md2kir4tdb0esla7k7e0psmpfnnkrvri8c8g8/family1/294563aeba2e46d78d84a6098885a37c 2023-07-12 13:15:36,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:15:36,827 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230712 table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:36,828 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:36,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-07-12 13:15:36,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(1912): c9662635c9aef48a82b6818321244591/family1 is initiating minor compaction (all files) 2023-07-12 13:15:36,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4fce0e0f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-07-12 13:15:36,829 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202307120941e4843624445ea426f7f9d1d3b7f1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202307120941e4843624445ea426f7f9d1d3b7f1 2023-07-12 13:15:36,830 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230712 table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:36,830 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202307123176af7e6cf648028f20c159f6cbd3da to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202307123176af7e6cf648028f20c159f6cbd3da 2023-07-12 13:15:36,831 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:36,831 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023071245cdeff6f95d450785c963fbc1a8c753 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023071245cdeff6f95d450785c963fbc1a8c753 2023-07-12 13:15:36,832 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023071210e4d113160e4b619b13c7fb902e4140 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023071210e4d113160e4b619b13c7fb902e4140 2023-07-12 13:15:36,832 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230712871db3f5f2fd46998a2101e6c7bb7c28 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230712871db3f5f2fd46998a2101e6c7bb7c28 2023-07-12 13:15:36,832 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-12 13:15:36,832 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230712' 2023-07-12 13:15:36,833 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230712 for table='testCompactionWithHFileLink' and column='family1' 2023-07-12 13:15:36,833 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202307125dec2e95a11f4647a869cce690c3a76a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202307125dec2e95a11f4647a869cce690c3a76a 2023-07-12 13:15:36,835 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230712900d4cd6d6eb42819a02679754927ecc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230712900d4cd6d6eb42819a02679754927ecc 2023-07-12 13:15:36,836 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230712efb92ae907634cb6a2f4e17a5a44fd86 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230712efb92ae907634cb6a2f4e17a5a44fd86 2023-07-12 13:15:36,836 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-12 13:15:36,836 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230712' 2023-07-12 13:15:36,836 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230712 for table='testCompactionWithHFileLink' and column='family1' 2023-07-12 13:15:37,165 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307120dcd767ec7344ea9a85f3d042309609e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307120dcd767ec7344ea9a85f3d042309609e 2023-07-12 13:15:37,166 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230712 table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:37,188 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230712/family1/7f80fe3d8bbd4faaa169c318e532f0ff first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-07-12 13:15:37,188 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=32 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230712/family1/7f80fe3d8bbd4faaa169c318e532f0ff}] 2023-07-12 13:15:37,190 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230712/family1/7f80fe3d8bbd4faaa169c318e532f0ff for inclusion in 684e9c34724c737ee5eb5d368452e637/family1 2023-07-12 13:15:37,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-07-12 13:15:37,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last=1 2023-07-12 13:15:37,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:37,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230712/family1/7f80fe3d8bbd4faaa169c318e532f0ff to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__jfsji0apcpvppf247e0q6ouk7979vrtvrl9bdmfkb8pksab1rli428hehdf01clb/family1/7f80fe3d8bbd4faaa169c318e532f0ff 2023-07-12 13:15:37,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__jfsji0apcpvppf247e0q6ouk7979vrtvrl9bdmfkb8pksab1rli428hehdf01clb/family1/7f80fe3d8bbd4faaa169c318e532f0ff as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/e2073efbbc104dc7b2773563a1e77519_SeqId_34_ 2023-07-12 13:15:37,196 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__jfsji0apcpvppf247e0q6ouk7979vrtvrl9bdmfkb8pksab1rli428hehdf01clb/family1/7f80fe3d8bbd4faaa169c318e532f0ff into 684e9c34724c737ee5eb5d368452e637/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/e2073efbbc104dc7b2773563a1e77519_SeqId_34_ - updating store file list. 2023-07-12 13:15:37,200 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/e2073efbbc104dc7b2773563a1e77519_SeqId_34_ into 684e9c34724c737ee5eb5d368452e637/family1 2023-07-12 13:15:37,200 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__jfsji0apcpvppf247e0q6ouk7979vrtvrl9bdmfkb8pksab1rli428hehdf01clb/family1/7f80fe3d8bbd4faaa169c318e532f0ff into 684e9c34724c737ee5eb5d368452e637/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/e2073efbbc104dc7b2773563a1e77519_SeqId_34_) 2023-07-12 13:15:37,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testCompactionWithHFileLink__jfsji0apcpvppf247e0q6ouk7979vrtvrl9bdmfkb8pksab1rli428hehdf01clb/family1/7f80fe3d8bbd4faaa169c318e532f0ff 2023-07-12 13:15:37,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:15:37,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-07-12 13:15:37,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(1912): 684e9c34724c737ee5eb5d368452e637/family1 is initiating minor compaction (all files) 2023-07-12 13:15:37,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@77a3c578; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-07-12 13:15:37,205 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230712 table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:37,206 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:37,207 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023071287169779b97148ee9f3892d1e355d2b0 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023071287169779b97148ee9f3892d1e355d2b0 2023-07-12 13:15:37,208 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202307128c746917627b42f58f61962d2d2b7b5a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202307128c746917627b42f58f61962d2d2b7b5a 2023-07-12 13:15:37,209 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230712eb54a68ddba04ce78456026abc3bb59f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230712eb54a68ddba04ce78456026abc3bb59f 2023-07-12 13:15:37,211 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230712fe9d1084ca5b41a18a37f96c6efbdb0f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230712fe9d1084ca5b41a18a37f96c6efbdb0f 2023-07-12 13:15:37,211 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-12 13:15:37,211 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230712' 2023-07-12 13:15:37,211 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230712 for table='testCompactionWithHFileLink' and column='family1' 2023-07-12 13:15:37,211 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-07-12 13:15:37,214 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:37,216 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:37,221 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:37,222 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:37,231 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:37,232 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:37,248 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=287 (was 255) - Thread LEAK? -, OpenFileDescriptor=765 (was 646) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=144 (was 206), ProcessCount=166 (was 166), AvailableMemoryMB=7604 (was 7919) 2023-07-12 13:15:37,260 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=287, OpenFileDescriptor=765, MaxFileDescriptor=60000, SystemLoadAverage=144, ProcessCount=166, AvailableMemoryMB=7603 2023-07-12 13:15:37,265 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.HMaster$15(3014): Client=jenkins//136.243.18.41 creating {NAME => 'ns'} 2023-07-12 13:15:37,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-07-12 13:15:37,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 13:15:37,271 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 13:15:37,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 6 msec 2023-07-12 13:15:37,275 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family1/83ee4dd2bdbf41b8a2c9b1d2f59cef00 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/83ee4dd2bdbf41b8a2c9b1d2f59cef00 2023-07-12 13:15:37,280 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-07-12 13:15:37,281 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 9c3dd1c27a1a45c43f96b95fb3aa34b8/family1 of 9c3dd1c27a1a45c43f96b95fb3aa34b8 into 83ee4dd2bdbf41b8a2c9b1d2f59cef00(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:15:37,281 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:37,281 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8., storeName=9c3dd1c27a1a45c43f96b95fb3aa34b8/family1, priority=12, startTime=1689167736007; duration=1sec 2023-07-12 13:15:37,281 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-07-12 13:15:37,281 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c9662635c9aef48a82b6818321244591/family1 in testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:37,281 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-98c96d9ec7164b0c9e4e2740144261e4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-67b7de58b2134506aa21b79c5ead4bb4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-add5584e719b4cd3ab22db193414bd4a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-8b96dfbdc0934784a142ee622c889b86, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/e82951e3b495467086ef498f248aeebd_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp, totalSize=28.9 K 2023-07-12 13:15:37,282 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/.tmp/family2/40a0b36d341f4f719fa69d55156d1d8a as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/40a0b36d341f4f719fa69d55156d1d8a 2023-07-12 13:15:37,282 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-98c96d9ec7164b0c9e4e2740144261e4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167712042 2023-07-12 13:15:37,283 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-67b7de58b2134506aa21b79c5ead4bb4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167713890 2023-07-12 13:15:37,283 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-add5584e719b4cd3ab22db193414bd4a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167715693 2023-07-12 13:15:37,284 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-8b96dfbdc0934784a142ee622c889b86, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167717113 2023-07-12 13:15:37,284 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting e82951e3b495467086ef498f248aeebd_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1689167712042 2023-07-12 13:15:37,288 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 9c3dd1c27a1a45c43f96b95fb3aa34b8/family2 of 9c3dd1c27a1a45c43f96b95fb3aa34b8 into 40a0b36d341f4f719fa69d55156d1d8a(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:15:37,288 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:15:37,288 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8., storeName=9c3dd1c27a1a45c43f96b95fb3aa34b8/family2, priority=12, startTime=1689167736008; duration=1sec 2023-07-12 13:15:37,288 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-07-12 13:15:37,288 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 684e9c34724c737ee5eb5d368452e637/family1 in testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:37,288 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-ac3029b2ba8840569b178aa508e0ea97, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-04c0fd3198224028a40240310b5556a4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-fb5dcfa8cda6468c810a8804e8fcdad2, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-6139ff44e92a436c835fe1ada2e7d0dc, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/e2073efbbc104dc7b2773563a1e77519_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp, totalSize=28.9 K 2023-07-12 13:15:37,289 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-ac3029b2ba8840569b178aa508e0ea97, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167712040 2023-07-12 13:15:37,289 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-04c0fd3198224028a40240310b5556a4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167713890 2023-07-12 13:15:37,290 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-fb5dcfa8cda6468c810a8804e8fcdad2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167715692 2023-07-12 13:15:37,291 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-6139ff44e92a436c835fe1ada2e7d0dc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167717112 2023-07-12 13:15:37,291 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting e2073efbbc104dc7b2773563a1e77519_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1689167712040 2023-07-12 13:15:37,302 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): c9662635c9aef48a82b6818321244591#family1#compaction#116 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:37,308 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] throttle.PressureAwareThroughputController(145): 684e9c34724c737ee5eb5d368452e637#family1#compaction#117 average throughput is 2.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:37,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-2aa69aa56e324088b3e9ae8eb04f5204, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-058aa9a11dd54cc7941b7afb8f7de47b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-7127f07493ed4f5da2d22b562a0ea1ed, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-61ac1037c26741818a4ef3077263a14e] to archive 2023-07-12 13:15:37,371 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:37,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 13:15:37,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-2aa69aa56e324088b3e9ae8eb04f5204 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-2aa69aa56e324088b3e9ae8eb04f5204 2023-07-12 13:15:37,375 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 13:15:37,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-07-12 13:15:37,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-058aa9a11dd54cc7941b7afb8f7de47b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-058aa9a11dd54cc7941b7afb8f7de47b 2023-07-12 13:15:37,378 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:15:37,378 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-07-12 13:15:37,379 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:15:37,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 13:15:37,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-7127f07493ed4f5da2d22b562a0ea1ed to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-7127f07493ed4f5da2d22b562a0ea1ed 2023-07-12 13:15:37,381 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-61ac1037c26741818a4ef3077263a14e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family1/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-61ac1037c26741818a4ef3077263a14e 2023-07-12 13:15:37,381 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1 2023-07-12 13:15:37,381 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d 2023-07-12 13:15:37,381 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d 2023-07-12 13:15:37,382 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1 empty. 2023-07-12 13:15:37,382 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d empty. 2023-07-12 13:15:37,382 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d empty. 2023-07-12 13:15:37,382 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1 2023-07-12 13:15:37,382 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d 2023-07-12 13:15:37,382 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d 2023-07-12 13:15:37,382 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-07-12 13:15:37,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-9f940e710eea4544a0ea53b174ebee2b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-f1c8b53a8c0943b1a10cd93917fcfc1b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-8cffb17142ac4e04a69c8ae5d0ad3b2a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-e459491ae4344c89aefef7bff114515a] to archive 2023-07-12 13:15:37,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:37,385 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-9f940e710eea4544a0ea53b174ebee2b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-9f940e710eea4544a0ea53b174ebee2b 2023-07-12 13:15:37,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-f1c8b53a8c0943b1a10cd93917fcfc1b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-f1c8b53a8c0943b1a10cd93917fcfc1b 2023-07-12 13:15:37,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-8cffb17142ac4e04a69c8ae5d0ad3b2a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-8cffb17142ac4e04a69c8ae5d0ad3b2a 2023-07-12 13:15:37,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-e459491ae4344c89aefef7bff114515a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/family2/testCompactionWithHFileLink=9c3dd1c27a1a45c43f96b95fb3aa34b8-e459491ae4344c89aefef7bff114515a 2023-07-12 13:15:37,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 13:15:37,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 13:15:37,793 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-07-12 13:15:37,796 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => a34870d754173c6eb017e5976ddb69b1, NAME => 'ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:15:37,797 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 76d13adf9ec2fbd57aa0f03e10ecb66d, NAME => 'ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:15:37,797 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => d10e316608e6877e6e7709797b53ca2d, NAME => 'ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:15:37,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 13:15:38,195 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 13:15:38,213 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:38,213 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:38,213 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 76d13adf9ec2fbd57aa0f03e10ecb66d, disabling compactions & flushes 2023-07-12 13:15:38,213 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing a34870d754173c6eb017e5976ddb69b1, disabling compactions & flushes 2023-07-12 13:15:38,213 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:38,213 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:38,213 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:38,213 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:38,213 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. after waiting 0 ms 2023-07-12 13:15:38,213 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. after waiting 0 ms 2023-07-12 13:15:38,213 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:38,213 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:38,213 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:38,213 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:38,213 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 76d13adf9ec2fbd57aa0f03e10ecb66d: 2023-07-12 13:15:38,213 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for a34870d754173c6eb017e5976ddb69b1: 2023-07-12 13:15:38,219 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:38,220 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing d10e316608e6877e6e7709797b53ca2d, disabling compactions & flushes 2023-07-12 13:15:38,220 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:38,220 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:38,220 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. after waiting 0 ms 2023-07-12 13:15:38,220 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:38,220 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:38,220 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for d10e316608e6877e6e7709797b53ca2d: 2023-07-12 13:15:38,222 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:15:38,223 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1689167738222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167738222"}]},"ts":"1689167738222"} 2023-07-12 13:15:38,223 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689167738222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167738222"}]},"ts":"1689167738222"} 2023-07-12 13:15:38,223 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689167738222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167738222"}]},"ts":"1689167738222"} 2023-07-12 13:15:38,225 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-12 13:15:38,225 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:15:38,225 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167738225"}]},"ts":"1689167738225"} 2023-07-12 13:15:38,226 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-07-12 13:15:38,229 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a34870d754173c6eb017e5976ddb69b1, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=76d13adf9ec2fbd57aa0f03e10ecb66d, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d10e316608e6877e6e7709797b53ca2d, ASSIGN}] 2023-07-12 13:15:38,230 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=76d13adf9ec2fbd57aa0f03e10ecb66d, ASSIGN 2023-07-12 13:15:38,231 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a34870d754173c6eb017e5976ddb69b1, ASSIGN 2023-07-12 13:15:38,231 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d10e316608e6877e6e7709797b53ca2d, ASSIGN 2023-07-12 13:15:38,231 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=76d13adf9ec2fbd57aa0f03e10ecb66d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:15:38,231 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a34870d754173c6eb017e5976ddb69b1, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:15:38,231 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d10e316608e6877e6e7709797b53ca2d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:15:38,387 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a34870d754173c6eb017e5976ddb69b1, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:38,387 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=d10e316608e6877e6e7709797b53ca2d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:38,388 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689167738387"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167738387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167738387"}]},"ts":"1689167738387"} 2023-07-12 13:15:38,388 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689167738387"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167738387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167738387"}]},"ts":"1689167738387"} 2023-07-12 13:15:38,387 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=76d13adf9ec2fbd57aa0f03e10ecb66d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:38,388 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1689167738387"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167738387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167738387"}]},"ts":"1689167738387"} 2023-07-12 13:15:38,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure a34870d754173c6eb017e5976ddb69b1, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:38,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure d10e316608e6877e6e7709797b53ca2d, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:38,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 76d13adf9ec2fbd57aa0f03e10ecb66d, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:38,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 13:15:38,534 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family1/c6949e5dfc074bfa99a54c18977cb8e2 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/c6949e5dfc074bfa99a54c18977cb8e2 2023-07-12 13:15:38,535 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family1/21401fa3925a4930ba0befebe385b93f as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/21401fa3925a4930ba0befebe385b93f 2023-07-12 13:15:38,541 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 684e9c34724c737ee5eb5d368452e637/family1 of 684e9c34724c737ee5eb5d368452e637 into 21401fa3925a4930ba0befebe385b93f(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:15:38,541 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in c9662635c9aef48a82b6818321244591/family1 of c9662635c9aef48a82b6818321244591 into c6949e5dfc074bfa99a54c18977cb8e2(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:15:38,541 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:38,541 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:38,541 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1689167737203; duration=1sec 2023-07-12 13:15:38,541 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1689167736828; duration=1sec 2023-07-12 13:15:38,541 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-07-12 13:15:38,541 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-07-12 13:15:38,541 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-12 13:15:38,541 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-12 13:15:38,543 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-12 13:15:38,543 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-12 13:15:38,544 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HStore(1912): c9662635c9aef48a82b6818321244591/family2 is initiating minor compaction (all files) 2023-07-12 13:15:38,544 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1912): 684e9c34724c737ee5eb5d368452e637/family2 is initiating minor compaction (all files) 2023-07-12 13:15:38,544 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HRegion(2259): Starting compaction of c9662635c9aef48a82b6818321244591/family2 in testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:15:38,544 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 684e9c34724c737ee5eb5d368452e637/family2 in testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:15:38,544 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-e360b016c292406c9af549f09c05cf50, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-1a646d40dbb346f29d1105dfa4bf26d4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-becbb35b762347e9a93052b8104401a9, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-9edbf3c966d24513a206c3a825c590d1] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp, totalSize=20.4 K 2023-07-12 13:15:38,544 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-dbe2d55ba4064942b00e7acd854624a3, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-b1bb4c69875342b583d1bb33bb5f0812, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-9b7a0e928eb043c6a64ccdcdcff789f1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-0cd811c0249f434e9a2e8af031613111] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp, totalSize=20.4 K 2023-07-12 13:15:38,544 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-e360b016c292406c9af549f09c05cf50, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167712040 2023-07-12 13:15:38,544 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-dbe2d55ba4064942b00e7acd854624a3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167712042 2023-07-12 13:15:38,545 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-1a646d40dbb346f29d1105dfa4bf26d4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167713890 2023-07-12 13:15:38,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:38,545 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-b1bb4c69875342b583d1bb33bb5f0812, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167713890 2023-07-12 13:15:38,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 76d13adf9ec2fbd57aa0f03e10ecb66d, NAME => 'ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d.', STARTKEY => '1', ENDKEY => '2'} 2023-07-12 13:15:38,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 76d13adf9ec2fbd57aa0f03e10ecb66d 2023-07-12 13:15:38,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:38,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 76d13adf9ec2fbd57aa0f03e10ecb66d 2023-07-12 13:15:38,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 76d13adf9ec2fbd57aa0f03e10ecb66d 2023-07-12 13:15:38,546 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-becbb35b762347e9a93052b8104401a9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167715692 2023-07-12 13:15:38,546 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-9b7a0e928eb043c6a64ccdcdcff789f1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167715693 2023-07-12 13:15:38,546 INFO [StoreOpener-76d13adf9ec2fbd57aa0f03e10ecb66d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 76d13adf9ec2fbd57aa0f03e10ecb66d 2023-07-12 13:15:38,547 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-9edbf3c966d24513a206c3a825c590d1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167717112 2023-07-12 13:15:38,547 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-0cd811c0249f434e9a2e8af031613111, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167717113 2023-07-12 13:15:38,548 DEBUG [StoreOpener-76d13adf9ec2fbd57aa0f03e10ecb66d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1 2023-07-12 13:15:38,548 DEBUG [StoreOpener-76d13adf9ec2fbd57aa0f03e10ecb66d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1 2023-07-12 13:15:38,548 INFO [StoreOpener-76d13adf9ec2fbd57aa0f03e10ecb66d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76d13adf9ec2fbd57aa0f03e10ecb66d columnFamilyName family1 2023-07-12 13:15:38,549 INFO [StoreOpener-76d13adf9ec2fbd57aa0f03e10ecb66d-1] regionserver.HStore(310): Store=76d13adf9ec2fbd57aa0f03e10ecb66d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:38,549 INFO [StoreOpener-76d13adf9ec2fbd57aa0f03e10ecb66d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 76d13adf9ec2fbd57aa0f03e10ecb66d 2023-07-12 13:15:38,551 DEBUG [StoreOpener-76d13adf9ec2fbd57aa0f03e10ecb66d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2 2023-07-12 13:15:38,551 DEBUG [StoreOpener-76d13adf9ec2fbd57aa0f03e10ecb66d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2 2023-07-12 13:15:38,551 INFO [StoreOpener-76d13adf9ec2fbd57aa0f03e10ecb66d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76d13adf9ec2fbd57aa0f03e10ecb66d columnFamilyName family2 2023-07-12 13:15:38,552 INFO [StoreOpener-76d13adf9ec2fbd57aa0f03e10ecb66d-1] regionserver.HStore(310): Store=76d13adf9ec2fbd57aa0f03e10ecb66d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:38,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d 2023-07-12 13:15:38,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d 2023-07-12 13:15:38,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:15:38,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 76d13adf9ec2fbd57aa0f03e10ecb66d 2023-07-12 13:15:38,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:15:38,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 76d13adf9ec2fbd57aa0f03e10ecb66d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66893123, jitterRate=-0.003214791417121887}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:15:38,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 76d13adf9ec2fbd57aa0f03e10ecb66d: 2023-07-12 13:15:38,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d., pid=111, masterSystemTime=1689167738543 2023-07-12 13:15:38,559 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 684e9c34724c737ee5eb5d368452e637#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:38,560 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] throttle.PressureAwareThroughputController(145): c9662635c9aef48a82b6818321244591#family2#compaction#119 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:38,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:38,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:38,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:38,561 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=76d13adf9ec2fbd57aa0f03e10ecb66d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:38,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d10e316608e6877e6e7709797b53ca2d, NAME => 'ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 13:15:38,561 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1689167738561"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167738561"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167738561"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167738561"}]},"ts":"1689167738561"} 2023-07-12 13:15:38,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction d10e316608e6877e6e7709797b53ca2d 2023-07-12 13:15:38,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:38,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for d10e316608e6877e6e7709797b53ca2d 2023-07-12 13:15:38,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for d10e316608e6877e6e7709797b53ca2d 2023-07-12 13:15:38,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-07-12 13:15:38,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 76d13adf9ec2fbd57aa0f03e10ecb66d, server=jenkins-hbase17.apache.org,41721,1689167613545 in 170 msec 2023-07-12 13:15:38,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=76d13adf9ec2fbd57aa0f03e10ecb66d, ASSIGN in 334 msec 2023-07-12 13:15:38,564 INFO [StoreOpener-d10e316608e6877e6e7709797b53ca2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d10e316608e6877e6e7709797b53ca2d 2023-07-12 13:15:38,568 DEBUG [StoreOpener-d10e316608e6877e6e7709797b53ca2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1 2023-07-12 13:15:38,569 DEBUG [StoreOpener-d10e316608e6877e6e7709797b53ca2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1 2023-07-12 13:15:38,569 INFO [StoreOpener-d10e316608e6877e6e7709797b53ca2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d10e316608e6877e6e7709797b53ca2d columnFamilyName family1 2023-07-12 13:15:38,570 INFO [StoreOpener-d10e316608e6877e6e7709797b53ca2d-1] regionserver.HStore(310): Store=d10e316608e6877e6e7709797b53ca2d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:38,570 INFO [StoreOpener-d10e316608e6877e6e7709797b53ca2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d10e316608e6877e6e7709797b53ca2d 2023-07-12 13:15:38,571 DEBUG [StoreOpener-d10e316608e6877e6e7709797b53ca2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2 2023-07-12 13:15:38,571 DEBUG [StoreOpener-d10e316608e6877e6e7709797b53ca2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2 2023-07-12 13:15:38,571 INFO [StoreOpener-d10e316608e6877e6e7709797b53ca2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d10e316608e6877e6e7709797b53ca2d columnFamilyName family2 2023-07-12 13:15:38,572 INFO [StoreOpener-d10e316608e6877e6e7709797b53ca2d-1] regionserver.HStore(310): Store=d10e316608e6877e6e7709797b53ca2d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:38,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d 2023-07-12 13:15:38,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d 2023-07-12 13:15:38,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:15:38,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for d10e316608e6877e6e7709797b53ca2d 2023-07-12 13:15:38,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:15:38,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-ac3029b2ba8840569b178aa508e0ea97, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-04c0fd3198224028a40240310b5556a4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-fb5dcfa8cda6468c810a8804e8fcdad2, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-6139ff44e92a436c835fe1ada2e7d0dc, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/e2073efbbc104dc7b2773563a1e77519_SeqId_34_] to archive 2023-07-12 13:15:38,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened d10e316608e6877e6e7709797b53ca2d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68442699, jitterRate=0.01987569034099579}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:15:38,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for d10e316608e6877e6e7709797b53ca2d: 2023-07-12 13:15:38,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:38,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d., pid=110, masterSystemTime=1689167738543 2023-07-12 13:15:38,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-ac3029b2ba8840569b178aa508e0ea97 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-ac3029b2ba8840569b178aa508e0ea97 2023-07-12 13:15:38,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:38,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:38,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:38,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a34870d754173c6eb017e5976ddb69b1, NAME => 'ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 13:15:38,578 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=d10e316608e6877e6e7709797b53ca2d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:38,578 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689167738578"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167738578"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167738578"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167738578"}]},"ts":"1689167738578"} 2023-07-12 13:15:38,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction a34870d754173c6eb017e5976ddb69b1 2023-07-12 13:15:38,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-04c0fd3198224028a40240310b5556a4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-04c0fd3198224028a40240310b5556a4 2023-07-12 13:15:38,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:38,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a34870d754173c6eb017e5976ddb69b1 2023-07-12 13:15:38,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a34870d754173c6eb017e5976ddb69b1 2023-07-12 13:15:38,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-fb5dcfa8cda6468c810a8804e8fcdad2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-fb5dcfa8cda6468c810a8804e8fcdad2 2023-07-12 13:15:38,580 INFO [StoreOpener-a34870d754173c6eb017e5976ddb69b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a34870d754173c6eb017e5976ddb69b1 2023-07-12 13:15:38,581 DEBUG [StoreOpener-a34870d754173c6eb017e5976ddb69b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1 2023-07-12 13:15:38,581 DEBUG [StoreOpener-a34870d754173c6eb017e5976ddb69b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1 2023-07-12 13:15:38,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-6139ff44e92a436c835fe1ada2e7d0dc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-6139ff44e92a436c835fe1ada2e7d0dc 2023-07-12 13:15:38,581 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=108 2023-07-12 13:15:38,581 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure d10e316608e6877e6e7709797b53ca2d, server=jenkins-hbase17.apache.org,41721,1689167613545 in 188 msec 2023-07-12 13:15:38,581 INFO [StoreOpener-a34870d754173c6eb017e5976ddb69b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a34870d754173c6eb017e5976ddb69b1 columnFamilyName family1 2023-07-12 13:15:38,581 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d10e316608e6877e6e7709797b53ca2d, ASSIGN in 352 msec 2023-07-12 13:15:38,582 INFO [StoreOpener-a34870d754173c6eb017e5976ddb69b1-1] regionserver.HStore(310): Store=a34870d754173c6eb017e5976ddb69b1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:38,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/e2073efbbc104dc7b2773563a1e77519_SeqId_34_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family1/e2073efbbc104dc7b2773563a1e77519_SeqId_34_ 2023-07-12 13:15:38,582 INFO [StoreOpener-a34870d754173c6eb017e5976ddb69b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a34870d754173c6eb017e5976ddb69b1 2023-07-12 13:15:38,583 DEBUG [StoreOpener-a34870d754173c6eb017e5976ddb69b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2 2023-07-12 13:15:38,583 DEBUG [StoreOpener-a34870d754173c6eb017e5976ddb69b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2 2023-07-12 13:15:38,583 INFO [StoreOpener-a34870d754173c6eb017e5976ddb69b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a34870d754173c6eb017e5976ddb69b1 columnFamilyName family2 2023-07-12 13:15:38,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-98c96d9ec7164b0c9e4e2740144261e4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-67b7de58b2134506aa21b79c5ead4bb4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-add5584e719b4cd3ab22db193414bd4a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-8b96dfbdc0934784a142ee622c889b86, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/e82951e3b495467086ef498f248aeebd_SeqId_34_] to archive 2023-07-12 13:15:38,584 INFO [StoreOpener-a34870d754173c6eb017e5976ddb69b1-1] regionserver.HStore(310): Store=a34870d754173c6eb017e5976ddb69b1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:38,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:38,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1 2023-07-12 13:15:38,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1 2023-07-12 13:15:38,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-98c96d9ec7164b0c9e4e2740144261e4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-98c96d9ec7164b0c9e4e2740144261e4 2023-07-12 13:15:38,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:15:38,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-67b7de58b2134506aa21b79c5ead4bb4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-67b7de58b2134506aa21b79c5ead4bb4 2023-07-12 13:15:38,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a34870d754173c6eb017e5976ddb69b1 2023-07-12 13:15:38,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-add5584e719b4cd3ab22db193414bd4a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-add5584e719b4cd3ab22db193414bd4a 2023-07-12 13:15:38,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-8b96dfbdc0934784a142ee622c889b86 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-8b96dfbdc0934784a142ee622c889b86 2023-07-12 13:15:38,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:15:38,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a34870d754173c6eb017e5976ddb69b1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69195526, jitterRate=0.031093686819076538}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:15:38,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a34870d754173c6eb017e5976ddb69b1: 2023-07-12 13:15:38,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/e82951e3b495467086ef498f248aeebd_SeqId_34_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family1/e82951e3b495467086ef498f248aeebd_SeqId_34_ 2023-07-12 13:15:38,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1., pid=109, masterSystemTime=1689167738543 2023-07-12 13:15:38,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:38,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:38,591 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a34870d754173c6eb017e5976ddb69b1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:38,591 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689167738591"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167738591"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167738591"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167738591"}]},"ts":"1689167738591"} 2023-07-12 13:15:38,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-12 13:15:38,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure a34870d754173c6eb017e5976ddb69b1, server=jenkins-hbase17.apache.org,41721,1689167613545 in 201 msec 2023-07-12 13:15:38,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-12 13:15:38,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a34870d754173c6eb017e5976ddb69b1, ASSIGN in 364 msec 2023-07-12 13:15:38,594 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:15:38,594 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167738594"}]},"ts":"1689167738594"} 2023-07-12 13:15:38,595 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-07-12 13:15:38,596 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:15:38,597 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2210 sec 2023-07-12 13:15:39,392 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/.tmp/family2/e1bc880af2374459902b8651860b017a as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/e1bc880af2374459902b8651860b017a 2023-07-12 13:15:39,398 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in c9662635c9aef48a82b6818321244591/family2 of c9662635c9aef48a82b6818321244591 into e1bc880af2374459902b8651860b017a(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:15:39,398 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:15:39,398 INFO [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591., storeName=c9662635c9aef48a82b6818321244591/family2, priority=12, startTime=1689167736091; duration=0sec 2023-07-12 13:15:39,399 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-07-12 13:15:39,399 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-12 13:15:39,399 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-07-12 13:15:39,399 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-07-12 13:15:39,399 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. because compaction request was cancelled 2023-07-12 13:15:39,399 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-12 13:15:39,400 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-07-12 13:15:39,400 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-07-12 13:15:39,400 DEBUG [RS:0;jenkins-hbase17:41721-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. because compaction request was cancelled 2023-07-12 13:15:39,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-dbe2d55ba4064942b00e7acd854624a3, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-b1bb4c69875342b583d1bb33bb5f0812, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-9b7a0e928eb043c6a64ccdcdcff789f1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-0cd811c0249f434e9a2e8af031613111] to archive 2023-07-12 13:15:39,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:39,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-dbe2d55ba4064942b00e7acd854624a3 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-dbe2d55ba4064942b00e7acd854624a3 2023-07-12 13:15:39,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 13:15:39,489 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-07-12 13:15:39,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-b1bb4c69875342b583d1bb33bb5f0812 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-b1bb4c69875342b583d1bb33bb5f0812 2023-07-12 13:15:39,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-9b7a0e928eb043c6a64ccdcdcff789f1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-9b7a0e928eb043c6a64ccdcdcff789f1 2023-07-12 13:15:39,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-0cd811c0249f434e9a2e8af031613111 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/family2/testCompactionWithHFileLink=c9662635c9aef48a82b6818321244591-0cd811c0249f434e9a2e8af031613111 2023-07-12 13:15:39,496 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:39,497 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:39,497 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:39,499 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:15:39,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-12 13:15:39,501 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-12 13:15:39,501 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:39,501 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-12 13:15:39,501 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-12 13:15:39,501 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:39,501 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:39,502 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:39,502 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:39,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:39,503 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:39,503 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:15:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:39,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:15:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:39,503 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-12 13:15:39,504 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-12 13:15:39,504 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-12 13:15:39,504 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:39,504 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-12 13:15:39,504 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:39,504 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. started... 2023-07-12 13:15:39,504 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:39,504 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. started... 2023-07-12 13:15:39,505 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:15:39,506 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d10e316608e6877e6e7709797b53ca2d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-12 13:15:39,506 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:15:39,506 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a34870d754173c6eb017e5976ddb69b1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-12 13:15:39,506 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:39,507 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. started... 2023-07-12 13:15:39,507 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76d13adf9ec2fbd57aa0f03e10ecb66d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-12 13:15:39,802 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/.tmp/family2/e6eafa7a6c3f4d499500e7aef80bf813 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/e6eafa7a6c3f4d499500e7aef80bf813 2023-07-12 13:15:39,810 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 684e9c34724c737ee5eb5d368452e637/family2 of 684e9c34724c737ee5eb5d368452e637 into e6eafa7a6c3f4d499500e7aef80bf813(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:15:39,810 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:15:39,810 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637., storeName=684e9c34724c737ee5eb5d368452e637/family2, priority=12, startTime=1689167736157; duration=1sec 2023-07-12 13:15:39,810 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:15:39,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-e360b016c292406c9af549f09c05cf50, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-1a646d40dbb346f29d1105dfa4bf26d4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-becbb35b762347e9a93052b8104401a9, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-9edbf3c966d24513a206c3a825c590d1] to archive 2023-07-12 13:15:39,871 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:39,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-e360b016c292406c9af549f09c05cf50 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-e360b016c292406c9af549f09c05cf50 2023-07-12 13:15:39,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-1a646d40dbb346f29d1105dfa4bf26d4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-1a646d40dbb346f29d1105dfa4bf26d4 2023-07-12 13:15:39,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-becbb35b762347e9a93052b8104401a9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-becbb35b762347e9a93052b8104401a9 2023-07-12 13:15:39,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-9edbf3c966d24513a206c3a825c590d1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/family2/testCompactionWithHFileLink=684e9c34724c737ee5eb5d368452e637-9edbf3c966d24513a206c3a825c590d1 2023-07-12 13:15:39,925 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307125515863209904a88aeba6b8a186c71ea to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202307125515863209904a88aeba6b8a186c71ea 2023-07-12 13:15:39,926 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307128c8ffab5580f4e819144dde120b9cfe0 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202307128c8ffab5580f4e819144dde120b9cfe0 2023-07-12 13:15:39,926 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071202e4b6b06f494eaaae342a4d726e3211 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023071202e4b6b06f494eaaae342a4d726e3211 2023-07-12 13:15:40,331 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family1/f31dcf52146744a7bcb4d0c7807fcf42 2023-07-12 13:15:40,331 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family1/1e56dbb084064a55b9f1d26bc8ff324f 2023-07-12 13:15:40,332 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family1/60da30a069b84564b396e50c34fc0dad 2023-07-12 13:15:40,758 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307128273efbc23a8413ca4097d3c9b945f7f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202307128273efbc23a8413ca4097d3c9b945f7f 2023-07-12 13:15:40,758 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071269e8204dc41147ec8eff3aaf3b1f040d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023071269e8204dc41147ec8eff3aaf3b1f040d 2023-07-12 13:15:40,758 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307127c50466c724142d3b2b30aa2ad14c4c2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202307127c50466c724142d3b2b30aa2ad14c4c2 2023-07-12 13:15:40,789 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-07-12 13:15:41,167 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family2/ce1e9160b8a3401e9bdd00dd98b1a5ef 2023-07-12 13:15:41,167 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family2/0d7e14af00ca4eeb893158f42a6836b5 2023-07-12 13:15:41,169 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family2/488c5d003ced4f2b824589c69d775574 2023-07-12 13:15:41,172 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family1/1e56dbb084064a55b9f1d26bc8ff324f as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/1e56dbb084064a55b9f1d26bc8ff324f 2023-07-12 13:15:41,172 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family1/f31dcf52146744a7bcb4d0c7807fcf42 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/f31dcf52146744a7bcb4d0c7807fcf42 2023-07-12 13:15:41,174 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family1/60da30a069b84564b396e50c34fc0dad as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/60da30a069b84564b396e50c34fc0dad 2023-07-12 13:15:41,176 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/f31dcf52146744a7bcb4d0c7807fcf42, entries=4, sequenceid=5, filesize=5.4 K 2023-07-12 13:15:41,176 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/1e56dbb084064a55b9f1d26bc8ff324f, entries=4, sequenceid=5, filesize=5.4 K 2023-07-12 13:15:41,177 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family2/0d7e14af00ca4eeb893158f42a6836b5 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/0d7e14af00ca4eeb893158f42a6836b5 2023-07-12 13:15:41,177 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family2/ce1e9160b8a3401e9bdd00dd98b1a5ef as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/ce1e9160b8a3401e9bdd00dd98b1a5ef 2023-07-12 13:15:41,178 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/60da30a069b84564b396e50c34fc0dad, entries=4, sequenceid=5, filesize=5.4 K 2023-07-12 13:15:41,179 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family2/488c5d003ced4f2b824589c69d775574 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/488c5d003ced4f2b824589c69d775574 2023-07-12 13:15:41,180 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/ce1e9160b8a3401e9bdd00dd98b1a5ef, entries=2, sequenceid=5, filesize=5.1 K 2023-07-12 13:15:41,180 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/0d7e14af00ca4eeb893158f42a6836b5, entries=2, sequenceid=5, filesize=5.1 K 2023-07-12 13:15:41,181 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d10e316608e6877e6e7709797b53ca2d in 1675ms, sequenceid=5, compaction requested=false 2023-07-12 13:15:41,181 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a34870d754173c6eb017e5976ddb69b1 in 1675ms, sequenceid=5, compaction requested=false 2023-07-12 13:15:41,182 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a34870d754173c6eb017e5976ddb69b1: 2023-07-12 13:15:41,182 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d10e316608e6877e6e7709797b53ca2d: 2023-07-12 13:15:41,182 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:41,182 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:41,182 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:15:41,182 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:15:41,183 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/488c5d003ced4f2b824589c69d775574, entries=2, sequenceid=5, filesize=5.1 K 2023-07-12 13:15:41,184 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 76d13adf9ec2fbd57aa0f03e10ecb66d in 1677ms, sequenceid=5, compaction requested=false 2023-07-12 13:15:41,184 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76d13adf9ec2fbd57aa0f03e10ecb66d: 2023-07-12 13:15:41,184 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:41,184 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:15:41,184 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:15:41,184 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,184 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-12 13:15:41,184 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-12 13:15:41,185 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:41,185 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:41,186 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:41,186 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:15:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:41,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-12 13:15:41,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3933a85a[Count = 0] remaining members to acquire global barrier 2023-07-12 13:15:41,187 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-12 13:15:41,187 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:41,188 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:41,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:41,188 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-12 13:15:41,188 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,188 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:15:41,188 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-12 13:15:41,188 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:15:41,189 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-12 13:15:41,189 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,189 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:41,189 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-12 13:15:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:15:41,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-12 13:15:41,191 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-12 13:15:41,191 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:15:41,191 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:15:41,191 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-12 13:15:41,191 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:15:41,191 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:41,191 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:41,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:41,191 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:41,192 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:41,193 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,194 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,194 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:41,194 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:41,194 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,194 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:41,194 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:41,194 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-12 13:15:41,194 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:15:41,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-07-12 13:15:41,194 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:41,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:41,194 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:41,194 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:41,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:41,194 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:41,194 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-12 13:15:41,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:41,195 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:15:41,295 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:15:41,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:15:41,298 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:41,298 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:41,298 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:41,301 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:15:41,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-07-12 13:15:41,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-12 13:15:41,303 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-12 13:15:41,303 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:41,303 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-12 13:15:41,303 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-12 13:15:41,304 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:41,304 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:41,305 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,305 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:41,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:41,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:41,305 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:41,305 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:15:41,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:41,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:41,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:15:41,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:41,307 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-12 13:15:41,307 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-07-12 13:15:41,307 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-12 13:15:41,307 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-12 13:15:41,307 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:41,307 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-12 13:15:41,308 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:41,308 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:15:41,308 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. started... 2023-07-12 13:15:41,308 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:41,308 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. started... 2023-07-12 13:15:41,308 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d10e316608e6877e6e7709797b53ca2d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-12 13:15:41,308 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76d13adf9ec2fbd57aa0f03e10ecb66d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-12 13:15:41,308 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:15:41,308 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:41,309 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. started... 2023-07-12 13:15:41,309 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a34870d754173c6eb017e5976ddb69b1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-12 13:15:41,736 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712717fbf07117646d3b4e0db97b3cc0b8f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230712717fbf07117646d3b4e0db97b3cc0b8f 2023-07-12 13:15:41,736 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712c03fa34543cf4868a6b69153a919688f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230712c03fa34543cf4868a6b69153a919688f 2023-07-12 13:15:41,736 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307126c11aaba76074b3d97655f00d1b9f1a7 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202307126c11aaba76074b3d97655f00d1b9f1a7 2023-07-12 13:15:41,747 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family1/d090c41738b44c27bf78f10b17307367 2023-07-12 13:15:42,147 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family1/a9edf2ce475848cfaefff92f0e392a0d 2023-07-12 13:15:42,147 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family1/c9562d5fb64d498588ca4e5a38281735 2023-07-12 13:15:42,159 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307122efaa9b695a84d80ae140b114ed86e33 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202307122efaa9b695a84d80ae140b114ed86e33 2023-07-12 13:15:42,565 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family2/bf8d2ef65ac74590a5123ac3e8221509 2023-07-12 13:15:42,568 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071298d3707e330c4a4496ecbe25c0112a0b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023071298d3707e330c4a4496ecbe25c0112a0b 2023-07-12 13:15:42,571 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family1/d090c41738b44c27bf78f10b17307367 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/d090c41738b44c27bf78f10b17307367 2023-07-12 13:15:42,573 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071292bbd1cd3e9a4e38abe8362dad092550 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023071292bbd1cd3e9a4e38abe8362dad092550 2023-07-12 13:15:42,575 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family2/f2ed1008d0374daeb73cdc559f20e9a7 2023-07-12 13:15:42,576 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/d090c41738b44c27bf78f10b17307367, entries=4, sequenceid=9, filesize=5.4 K 2023-07-12 13:15:42,577 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family2/bf8d2ef65ac74590a5123ac3e8221509 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/bf8d2ef65ac74590a5123ac3e8221509 2023-07-12 13:15:42,579 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family1/c9562d5fb64d498588ca4e5a38281735 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/c9562d5fb64d498588ca4e5a38281735 2023-07-12 13:15:42,581 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/bf8d2ef65ac74590a5123ac3e8221509, entries=2, sequenceid=9, filesize=5.1 K 2023-07-12 13:15:42,582 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a34870d754173c6eb017e5976ddb69b1 in 1273ms, sequenceid=9, compaction requested=false 2023-07-12 13:15:42,582 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a34870d754173c6eb017e5976ddb69b1: 2023-07-12 13:15:42,582 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:42,582 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:15:42,582 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/c9562d5fb64d498588ca4e5a38281735, entries=4, sequenceid=9, filesize=5.4 K 2023-07-12 13:15:42,583 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family2/f2ed1008d0374daeb73cdc559f20e9a7 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/f2ed1008d0374daeb73cdc559f20e9a7 2023-07-12 13:15:42,586 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/f2ed1008d0374daeb73cdc559f20e9a7, entries=2, sequenceid=9, filesize=5.1 K 2023-07-12 13:15:42,587 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d10e316608e6877e6e7709797b53ca2d in 1279ms, sequenceid=9, compaction requested=false 2023-07-12 13:15:42,587 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d10e316608e6877e6e7709797b53ca2d: 2023-07-12 13:15:42,587 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:42,587 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:15:42,979 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family2/c680a176c68041198ac674547d3f2b4b 2023-07-12 13:15:42,990 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family1/a9edf2ce475848cfaefff92f0e392a0d as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/a9edf2ce475848cfaefff92f0e392a0d 2023-07-12 13:15:42,996 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/a9edf2ce475848cfaefff92f0e392a0d, entries=4, sequenceid=9, filesize=5.4 K 2023-07-12 13:15:42,997 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family2/c680a176c68041198ac674547d3f2b4b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/c680a176c68041198ac674547d3f2b4b 2023-07-12 13:15:43,003 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/c680a176c68041198ac674547d3f2b4b, entries=2, sequenceid=9, filesize=5.1 K 2023-07-12 13:15:43,003 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 76d13adf9ec2fbd57aa0f03e10ecb66d in 1695ms, sequenceid=9, compaction requested=false 2023-07-12 13:15:43,004 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76d13adf9ec2fbd57aa0f03e10ecb66d: 2023-07-12 13:15:43,004 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:43,004 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:15:43,004 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:15:43,004 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,004 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-12 13:15:43,004 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-12 13:15:43,006 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,006 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:43,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:43,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:43,006 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:43,006 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:15:43,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:43,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:43,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:43,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:43,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-12 13:15:43,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@623165c4[Count = 0] remaining members to acquire global barrier 2023-07-12 13:15:43,008 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-12 13:15:43,008 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:43,008 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:43,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:43,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:43,008 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-12 13:15:43,008 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-12 13:15:43,008 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:15:43,008 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,008 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:15:43,009 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,009 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-12 13:15:43,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:43,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:43,009 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:43,009 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-12 13:15:43,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:43,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:43,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:43,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:43,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:43,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:15:43,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-12 13:15:43,011 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-12 13:15:43,011 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:15:43,011 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:15:43,011 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-12 13:15:43,011 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:15:43,012 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:43,012 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:43,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:43,012 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:43,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:43,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:43,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:43,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:43,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:43,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:43,012 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:43,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:43,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:43,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:43,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:43,013 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:43,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:43,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,015 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,015 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:43,015 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:43,015 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,015 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:43,015 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-12 13:15:43,015 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:15:43,015 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:43,015 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:43,015 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:43,015 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:43,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:43,015 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:43,015 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-12 13:15:43,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:43,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-07-12 13:15:43,015 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:15:43,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:43,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:43,116 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:15:43,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:15:43,118 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:43,118 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:43,119 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:43,122 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:15:43,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-07-12 13:15:43,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-12 13:15:43,125 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-12 13:15:43,125 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:43,125 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-12 13:15:43,125 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-12 13:15:43,126 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:43,126 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:43,127 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:43,127 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:43,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:43,128 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:43,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:43,128 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:15:43,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:43,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:15:43,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:43,130 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-12 13:15:43,130 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-07-12 13:15:43,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-12 13:15:43,130 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-12 13:15:43,130 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:43,130 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-12 13:15:43,130 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:43,131 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. started... 2023-07-12 13:15:43,131 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:43,131 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. started... 2023-07-12 13:15:43,131 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d10e316608e6877e6e7709797b53ca2d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-12 13:15:43,131 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a34870d754173c6eb017e5976ddb69b1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-12 13:15:43,131 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:15:43,131 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:15:43,131 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:43,131 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. started... 2023-07-12 13:15:43,132 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76d13adf9ec2fbd57aa0f03e10ecb66d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-12 13:15:43,548 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712f3ef7aab3d8b4145a4150d12f0b157bf to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230712f3ef7aab3d8b4145a4150d12f0b157bf 2023-07-12 13:15:43,550 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712b4e6d9bad6544fffb2b9d857f29effae to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230712b4e6d9bad6544fffb2b9d857f29effae 2023-07-12 13:15:43,553 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712a60509e07d304299a48003eb0f1b9d9c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230712a60509e07d304299a48003eb0f1b9d9c 2023-07-12 13:15:43,956 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family1/26e907182f9d44828361a7ac13865cb2 2023-07-12 13:15:43,956 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family1/fa52561e01f742f88057999ec1b8f4bc 2023-07-12 13:15:43,959 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family1/8509142ec0ca4b45805e609df409b7c2 2023-07-12 13:15:43,979 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712adec986153334a40891a9a14603e3de0 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230712adec986153334a40891a9a14603e3de0 2023-07-12 13:15:43,981 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071287924f58c47f4a97a5aa257532e024ab to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023071287924f58c47f4a97a5aa257532e024ab 2023-07-12 13:15:44,048 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 13:15:44,384 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family2/9b32018128e84985a20e9608f76d9014 2023-07-12 13:15:44,385 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307123046a11cc50f4dc2b2f2b548fe6ce0fb to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202307123046a11cc50f4dc2b2f2b548fe6ce0fb 2023-07-12 13:15:44,385 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family2/b45bea23c59c4645ae8d8a5f26452b3e 2023-07-12 13:15:44,391 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family1/fa52561e01f742f88057999ec1b8f4bc as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/fa52561e01f742f88057999ec1b8f4bc 2023-07-12 13:15:44,391 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family2/88b5d0f17b1b4c40b33774d784dda6b0 2023-07-12 13:15:44,392 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family1/8509142ec0ca4b45805e609df409b7c2 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/8509142ec0ca4b45805e609df409b7c2 2023-07-12 13:15:44,395 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/fa52561e01f742f88057999ec1b8f4bc, entries=4, sequenceid=13, filesize=5.4 K 2023-07-12 13:15:44,395 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family1/26e907182f9d44828361a7ac13865cb2 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/26e907182f9d44828361a7ac13865cb2 2023-07-12 13:15:44,396 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/8509142ec0ca4b45805e609df409b7c2, entries=4, sequenceid=13, filesize=5.4 K 2023-07-12 13:15:44,396 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family2/9b32018128e84985a20e9608f76d9014 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/9b32018128e84985a20e9608f76d9014 2023-07-12 13:15:44,396 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family2/b45bea23c59c4645ae8d8a5f26452b3e as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/b45bea23c59c4645ae8d8a5f26452b3e 2023-07-12 13:15:44,399 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/9b32018128e84985a20e9608f76d9014, entries=2, sequenceid=13, filesize=5.1 K 2023-07-12 13:15:44,400 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/b45bea23c59c4645ae8d8a5f26452b3e, entries=2, sequenceid=13, filesize=5.1 K 2023-07-12 13:15:44,400 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/26e907182f9d44828361a7ac13865cb2, entries=4, sequenceid=13, filesize=5.4 K 2023-07-12 13:15:44,400 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d10e316608e6877e6e7709797b53ca2d in 1269ms, sequenceid=13, compaction requested=true 2023-07-12 13:15:44,400 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 76d13adf9ec2fbd57aa0f03e10ecb66d in 1269ms, sequenceid=13, compaction requested=true 2023-07-12 13:15:44,401 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d10e316608e6877e6e7709797b53ca2d: 2023-07-12 13:15:44,401 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76d13adf9ec2fbd57aa0f03e10ecb66d: 2023-07-12 13:15:44,401 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:44,401 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:44,401 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:15:44,401 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:15:44,401 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family2/88b5d0f17b1b4c40b33774d784dda6b0 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/88b5d0f17b1b4c40b33774d784dda6b0 2023-07-12 13:15:44,405 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/88b5d0f17b1b4c40b33774d784dda6b0, entries=2, sequenceid=13, filesize=5.1 K 2023-07-12 13:15:44,405 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a34870d754173c6eb017e5976ddb69b1 in 1274ms, sequenceid=13, compaction requested=true 2023-07-12 13:15:44,406 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a34870d754173c6eb017e5976ddb69b1: 2023-07-12 13:15:44,406 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:44,406 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:15:44,406 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:15:44,406 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,406 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-12 13:15:44,406 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-12 13:15:44,407 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:44,407 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:44,407 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:44,407 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:15:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:44,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-12 13:15:44,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61a7c022[Count = 0] remaining members to acquire global barrier 2023-07-12 13:15:44,409 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-12 13:15:44,409 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:44,409 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:44,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:44,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:44,410 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-12 13:15:44,410 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-12 13:15:44,410 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:15:44,410 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,410 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:15:44,410 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-12 13:15:44,410 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:44,410 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,410 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-12 13:15:44,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:44,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:44,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:44,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:44,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:15:44,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-12 13:15:44,413 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-12 13:15:44,413 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:15:44,413 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:15:44,413 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-12 13:15:44,413 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:15:44,414 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:44,414 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:44,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:44,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:44,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:44,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:44,414 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:44,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:44,415 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:44,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:44,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,416 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,418 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,418 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:44,418 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:44,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:44,418 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:44,418 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:44,418 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-12 13:15:44,419 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:15:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:44,418 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:44,419 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,419 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:44,419 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:44,419 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:44,419 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-12 13:15:44,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:44,419 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:15:44,519 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:15:44,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:15:44,521 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:44,522 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:44,522 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:15:44,526 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:15:44,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-07-12 13:15:44,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-12 13:15:44,529 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-12 13:15:44,529 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:44,529 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-12 13:15:44,529 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-12 13:15:44,530 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:44,530 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:44,531 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,531 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:44,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:44,532 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:44,532 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:15:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:44,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:15:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:44,533 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-12 13:15:44,533 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-07-12 13:15:44,533 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-12 13:15:44,533 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-12 13:15:44,533 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:44,533 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-12 13:15:44,534 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:44,534 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. started... 2023-07-12 13:15:44,534 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:44,534 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:15:44,534 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:15:44,534 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d10e316608e6877e6e7709797b53ca2d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-12 13:15:44,534 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:44,534 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. started... 2023-07-12 13:15:44,534 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. started... 2023-07-12 13:15:44,534 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76d13adf9ec2fbd57aa0f03e10ecb66d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-12 13:15:44,534 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a34870d754173c6eb017e5976ddb69b1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-12 13:15:44,949 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712bedf146439e7492e94d2a5ef5d38b92c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230712bedf146439e7492e94d2a5ef5d38b92c 2023-07-12 13:15:44,949 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712cea53dd96a7c43b5b4fb268fa993c340 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230712cea53dd96a7c43b5b4fb268fa993c340 2023-07-12 13:15:44,949 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712bec078be78ce4e0f85a5686a814d43aa to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230712bec078be78ce4e0f85a5686a814d43aa 2023-07-12 13:15:45,354 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family1/272f34ab63d74d11b79b6b72d256ff2e 2023-07-12 13:15:45,354 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family1/38d8e63ba3e6420495d58a58d42455e6 2023-07-12 13:15:45,354 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family1/cc10b777be7848abb6c8e2edcbc28690 2023-07-12 13:15:45,814 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307121cca5c1c302542afbf49fbbd50d6cd98 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202307121cca5c1c302542afbf49fbbd50d6cd98 2023-07-12 13:15:45,815 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712983f5ec7dd1646b7993ef0785845c395 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230712983f5ec7dd1646b7993ef0785845c395 2023-07-12 13:15:45,815 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071256e37156c1ef470380ba3a499954a0e2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023071256e37156c1ef470380ba3a499954a0e2 2023-07-12 13:15:46,219 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family2/e5b33aa24d3741e692327a8be2e772c4 2023-07-12 13:15:46,220 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family2/34f5915794e94ba58e48c3e656f156e1 2023-07-12 13:15:46,220 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family2/293349f78d264f3ab16a6e02f91c5689 2023-07-12 13:15:46,224 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family1/38d8e63ba3e6420495d58a58d42455e6 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/38d8e63ba3e6420495d58a58d42455e6 2023-07-12 13:15:46,224 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family1/272f34ab63d74d11b79b6b72d256ff2e as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/272f34ab63d74d11b79b6b72d256ff2e 2023-07-12 13:15:46,224 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family1/cc10b777be7848abb6c8e2edcbc28690 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/cc10b777be7848abb6c8e2edcbc28690 2023-07-12 13:15:46,227 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/38d8e63ba3e6420495d58a58d42455e6, entries=4, sequenceid=17, filesize=5.4 K 2023-07-12 13:15:46,228 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/cc10b777be7848abb6c8e2edcbc28690, entries=4, sequenceid=17, filesize=5.4 K 2023-07-12 13:15:46,228 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/272f34ab63d74d11b79b6b72d256ff2e, entries=4, sequenceid=17, filesize=5.4 K 2023-07-12 13:15:46,228 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family2/34f5915794e94ba58e48c3e656f156e1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/34f5915794e94ba58e48c3e656f156e1 2023-07-12 13:15:46,228 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family2/293349f78d264f3ab16a6e02f91c5689 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/293349f78d264f3ab16a6e02f91c5689 2023-07-12 13:15:46,229 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family2/e5b33aa24d3741e692327a8be2e772c4 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/e5b33aa24d3741e692327a8be2e772c4 2023-07-12 13:15:46,233 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/34f5915794e94ba58e48c3e656f156e1, entries=2, sequenceid=17, filesize=5.1 K 2023-07-12 13:15:46,234 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a34870d754173c6eb017e5976ddb69b1 in 1700ms, sequenceid=17, compaction requested=true 2023-07-12 13:15:46,234 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a34870d754173c6eb017e5976ddb69b1: 2023-07-12 13:15:46,234 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:46,234 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:15:46,234 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/293349f78d264f3ab16a6e02f91c5689, entries=2, sequenceid=17, filesize=5.1 K 2023-07-12 13:15:46,235 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 76d13adf9ec2fbd57aa0f03e10ecb66d in 1700ms, sequenceid=17, compaction requested=true 2023-07-12 13:15:46,235 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76d13adf9ec2fbd57aa0f03e10ecb66d: 2023-07-12 13:15:46,235 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:46,235 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:15:46,238 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/e5b33aa24d3741e692327a8be2e772c4, entries=2, sequenceid=17, filesize=5.1 K 2023-07-12 13:15:46,238 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d10e316608e6877e6e7709797b53ca2d in 1704ms, sequenceid=17, compaction requested=true 2023-07-12 13:15:46,238 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d10e316608e6877e6e7709797b53ca2d: 2023-07-12 13:15:46,239 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:46,239 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:15:46,239 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:15:46,239 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,239 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-12 13:15:46,239 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-12 13:15:46,239 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:46,239 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:46,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:46,240 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:46,240 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:15:46,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:46,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:46,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:46,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:46,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-12 13:15:46,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9ab9ccf[Count = 0] remaining members to acquire global barrier 2023-07-12 13:15:46,242 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-12 13:15:46,242 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:46,242 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:46,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:46,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:46,243 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-12 13:15:46,243 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-12 13:15:46,243 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:15:46,243 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,243 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:15:46,243 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-12 13:15:46,243 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,244 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:46,244 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-12 13:15:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:46,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:46,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:46,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:46,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:15:46,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-12 13:15:46,246 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-12 13:15:46,246 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:15:46,246 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:15:46,246 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-12 13:15:46,246 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:15:46,248 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:46,248 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:46,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:46,248 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:46,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:46,248 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:46,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:46,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:46,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:46,249 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:46,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:46,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,251 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,251 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:46,251 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:46,251 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,251 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:46,251 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:46,251 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:46,251 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:46,251 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:46,251 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:46,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:46,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:46,251 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-12 13:15:46,252 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:15:46,252 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-12 13:15:46,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-07-12 13:15:46,252 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:15:46,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:46,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:46,352 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:15:46,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:15:46,363 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:46,373 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:46,382 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:46,383 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:46,413 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:15:46,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-07-12 13:15:46,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-12 13:15:46,416 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-12 13:15:46,416 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:46,416 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-12 13:15:46,416 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-12 13:15:46,416 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:46,416 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:46,417 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:46,417 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:46,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:46,417 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:46,417 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:15:46,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:46,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:46,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:15:46,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:46,418 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-12 13:15:46,418 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-07-12 13:15:46,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-12 13:15:46,418 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-12 13:15:46,418 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:46,418 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-12 13:15:46,419 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:46,419 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:46,419 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:46,419 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. started... 2023-07-12 13:15:46,419 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:15:46,419 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:15:46,419 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. started... 2023-07-12 13:15:46,419 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. started... 2023-07-12 13:15:46,419 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76d13adf9ec2fbd57aa0f03e10ecb66d 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-12 13:15:46,419 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a34870d754173c6eb017e5976ddb69b1 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-12 13:15:46,419 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d10e316608e6877e6e7709797b53ca2d 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-12 13:15:47,233 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family1/2af69597a9c24600a989b5e77869baa2 2023-07-12 13:15:47,234 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family1/5f5c945badfc410293db4df11b64d505 2023-07-12 13:15:47,236 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family1/201a167fc2fa458691c8ad744a987c23 2023-07-12 13:15:47,237 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2af69597a9c24600a989b5e77869baa2 2023-07-12 13:15:47,241 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f5c945badfc410293db4df11b64d505 2023-07-12 13:15:47,243 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 201a167fc2fa458691c8ad744a987c23 2023-07-12 13:15:47,679 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family2/43abada4b12b4ea79fdbfb650ccc9abc 2023-07-12 13:15:47,682 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43abada4b12b4ea79fdbfb650ccc9abc 2023-07-12 13:15:47,683 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family1/2af69597a9c24600a989b5e77869baa2 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/2af69597a9c24600a989b5e77869baa2 2023-07-12 13:15:47,686 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2af69597a9c24600a989b5e77869baa2 2023-07-12 13:15:47,686 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/2af69597a9c24600a989b5e77869baa2, entries=3, sequenceid=23, filesize=5.0 K 2023-07-12 13:15:47,687 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family2/43abada4b12b4ea79fdbfb650ccc9abc as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/43abada4b12b4ea79fdbfb650ccc9abc 2023-07-12 13:15:47,689 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family2/59ace3254fe14875b297a6bbd83727dc 2023-07-12 13:15:47,691 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43abada4b12b4ea79fdbfb650ccc9abc 2023-07-12 13:15:47,691 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/43abada4b12b4ea79fdbfb650ccc9abc, entries=1, sequenceid=23, filesize=5.0 K 2023-07-12 13:15:47,692 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d10e316608e6877e6e7709797b53ca2d in 1273ms, sequenceid=23, compaction requested=true 2023-07-12 13:15:47,692 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d10e316608e6877e6e7709797b53ca2d: 2023-07-12 13:15:47,692 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:47,692 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:15:47,700 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 59ace3254fe14875b297a6bbd83727dc 2023-07-12 13:15:47,702 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family1/5f5c945badfc410293db4df11b64d505 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/5f5c945badfc410293db4df11b64d505 2023-07-12 13:15:47,706 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f5c945badfc410293db4df11b64d505 2023-07-12 13:15:47,706 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/5f5c945badfc410293db4df11b64d505, entries=3, sequenceid=23, filesize=5.0 K 2023-07-12 13:15:47,707 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family2/59ace3254fe14875b297a6bbd83727dc as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/59ace3254fe14875b297a6bbd83727dc 2023-07-12 13:15:47,710 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 59ace3254fe14875b297a6bbd83727dc 2023-07-12 13:15:47,711 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/59ace3254fe14875b297a6bbd83727dc, entries=1, sequenceid=23, filesize=5.0 K 2023-07-12 13:15:47,712 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a34870d754173c6eb017e5976ddb69b1 in 1293ms, sequenceid=23, compaction requested=true 2023-07-12 13:15:47,712 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a34870d754173c6eb017e5976ddb69b1: 2023-07-12 13:15:47,712 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:47,712 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:15:48,088 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family2/33983d8beb7942e1afa450f11549f1a0 2023-07-12 13:15:48,092 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 33983d8beb7942e1afa450f11549f1a0 2023-07-12 13:15:48,092 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family1/201a167fc2fa458691c8ad744a987c23 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/201a167fc2fa458691c8ad744a987c23 2023-07-12 13:15:48,097 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 201a167fc2fa458691c8ad744a987c23 2023-07-12 13:15:48,097 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/201a167fc2fa458691c8ad744a987c23, entries=3, sequenceid=23, filesize=5.0 K 2023-07-12 13:15:48,099 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family2/33983d8beb7942e1afa450f11549f1a0 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/33983d8beb7942e1afa450f11549f1a0 2023-07-12 13:15:48,104 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 33983d8beb7942e1afa450f11549f1a0 2023-07-12 13:15:48,104 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/33983d8beb7942e1afa450f11549f1a0, entries=1, sequenceid=23, filesize=5.0 K 2023-07-12 13:15:48,105 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 76d13adf9ec2fbd57aa0f03e10ecb66d in 1686ms, sequenceid=23, compaction requested=true 2023-07-12 13:15:48,105 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76d13adf9ec2fbd57aa0f03e10ecb66d: 2023-07-12 13:15:48,105 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:48,105 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:15:48,105 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:15:48,105 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,105 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-12 13:15:48,105 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-12 13:15:48,106 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:48,106 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:48,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:48,106 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:48,107 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:15:48,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:48,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:48,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:48,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:48,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-12 13:15:48,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5652eb08[Count = 0] remaining members to acquire global barrier 2023-07-12 13:15:48,108 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-12 13:15:48,108 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:48,109 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:48,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:48,109 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-12 13:15:48,109 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,109 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:15:48,109 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-12 13:15:48,109 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:15:48,110 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-12 13:15:48,110 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,110 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:48,110 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-12 13:15:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:48,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:15:48,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-12 13:15:48,112 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-12 13:15:48,112 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:15:48,112 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:15:48,112 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-12 13:15:48,112 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:15:48,114 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:48,114 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:48,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:48,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:48,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:48,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:48,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:48,116 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:48,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:48,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:48,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:48,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:48,116 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:48,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,117 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-12 13:15:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,118 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,118 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:48,118 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:48,119 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-12 13:15:48,119 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:15:48,119 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-12 13:15:48,119 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:48,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:48,119 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:48,119 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:48,119 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-12 13:15:48,119 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:48,119 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:15:48,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:48,119 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-12 13:15:48,119 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-12 13:15:48,219 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:15:48,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:15:48,221 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:15:48,221 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): d10e316608e6877e6e7709797b53ca2d/family1 is initiating major compaction (all files) 2023-07-12 13:15:48,221 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:15:48,221 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:15:48,221 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of d10e316608e6877e6e7709797b53ca2d/family1 in ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:48,221 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/1e56dbb084064a55b9f1d26bc8ff324f, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/c9562d5fb64d498588ca4e5a38281735, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/fa52561e01f742f88057999ec1b8f4bc, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/272f34ab63d74d11b79b6b72d256ff2e, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/2af69597a9c24600a989b5e77869baa2] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp, totalSize=26.6 K 2023-07-12 13:15:48,222 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 1e56dbb084064a55b9f1d26bc8ff324f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167739497 2023-07-12 13:15:48,223 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting c9562d5fb64d498588ca4e5a38281735, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167741298 2023-07-12 13:15:48,223 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting fa52561e01f742f88057999ec1b8f4bc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167743119 2023-07-12 13:15:48,224 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 272f34ab63d74d11b79b6b72d256ff2e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167744522 2023-07-12 13:15:48,224 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 2af69597a9c24600a989b5e77869baa2, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-12 13:15:48,236 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): d10e316608e6877e6e7709797b53ca2d#family1#compaction#150 average throughput is 0.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:48,654 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023071279557f03371f4c7b83386a11f22fa425_del 2023-07-12 13:15:48,655 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071279557f03371f4c7b83386a11f22fa425_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023071279557f03371f4c7b83386a11f22fa425_del 2023-07-12 13:15:49,471 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2760aee0df8f47dea300062ad6563e8f 2023-07-12 13:15:49,472 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family1/2760aee0df8f47dea300062ad6563e8f as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/2760aee0df8f47dea300062ad6563e8f 2023-07-12 13:15:49,476 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2760aee0df8f47dea300062ad6563e8f 2023-07-12 13:15:49,476 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d10e316608e6877e6e7709797b53ca2d/family1 of d10e316608e6877e6e7709797b53ca2d into 2760aee0df8f47dea300062ad6563e8f(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:15:49,476 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for d10e316608e6877e6e7709797b53ca2d: 2023-07-12 13:15:49,476 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:15:49,477 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): d10e316608e6877e6e7709797b53ca2d/family2 is initiating major compaction (all files) 2023-07-12 13:15:49,477 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:15:49,477 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:15:49,477 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of d10e316608e6877e6e7709797b53ca2d/family2 in ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:15:49,477 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/ce1e9160b8a3401e9bdd00dd98b1a5ef, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/f2ed1008d0374daeb73cdc559f20e9a7, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/9b32018128e84985a20e9608f76d9014, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/e5b33aa24d3741e692327a8be2e772c4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/43abada4b12b4ea79fdbfb650ccc9abc] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp, totalSize=25.3 K 2023-07-12 13:15:49,477 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting ce1e9160b8a3401e9bdd00dd98b1a5ef, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167739497 2023-07-12 13:15:49,478 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting f2ed1008d0374daeb73cdc559f20e9a7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167741298 2023-07-12 13:15:49,478 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 9b32018128e84985a20e9608f76d9014, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167743119 2023-07-12 13:15:49,478 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting e5b33aa24d3741e692327a8be2e772c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167744522 2023-07-12 13:15:49,479 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 43abada4b12b4ea79fdbfb650ccc9abc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-12 13:15:49,488 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): d10e316608e6877e6e7709797b53ca2d#family2#compaction#151 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:49,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/1e56dbb084064a55b9f1d26bc8ff324f, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/c9562d5fb64d498588ca4e5a38281735, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/fa52561e01f742f88057999ec1b8f4bc, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/272f34ab63d74d11b79b6b72d256ff2e, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/2af69597a9c24600a989b5e77869baa2] to archive 2023-07-12 13:15:49,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:49,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/1e56dbb084064a55b9f1d26bc8ff324f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/1e56dbb084064a55b9f1d26bc8ff324f 2023-07-12 13:15:49,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/c9562d5fb64d498588ca4e5a38281735 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/c9562d5fb64d498588ca4e5a38281735 2023-07-12 13:15:49,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/fa52561e01f742f88057999ec1b8f4bc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/fa52561e01f742f88057999ec1b8f4bc 2023-07-12 13:15:49,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/272f34ab63d74d11b79b6b72d256ff2e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/272f34ab63d74d11b79b6b72d256ff2e 2023-07-12 13:15:49,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/2af69597a9c24600a989b5e77869baa2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/2af69597a9c24600a989b5e77869baa2 2023-07-12 13:15:49,900 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230712686f242ec03f4a1aaf2f5739a148f639_del 2023-07-12 13:15:49,900 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712686f242ec03f4a1aaf2f5739a148f639_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230712686f242ec03f4a1aaf2f5739a148f639_del 2023-07-12 13:15:50,323 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d532867925bc4543b0fe46e28f2cae0d 2023-07-12 13:15:50,324 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/.tmp/family2/d532867925bc4543b0fe46e28f2cae0d as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/d532867925bc4543b0fe46e28f2cae0d 2023-07-12 13:15:50,328 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d532867925bc4543b0fe46e28f2cae0d 2023-07-12 13:15:50,328 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d10e316608e6877e6e7709797b53ca2d/family2 of d10e316608e6877e6e7709797b53ca2d into d532867925bc4543b0fe46e28f2cae0d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:15:50,329 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for d10e316608e6877e6e7709797b53ca2d: 2023-07-12 13:15:50,329 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:15:50,329 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): a34870d754173c6eb017e5976ddb69b1/family1 is initiating major compaction (all files) 2023-07-12 13:15:50,329 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:15:50,329 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:15:50,329 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of a34870d754173c6eb017e5976ddb69b1/family1 in ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:50,329 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/f31dcf52146744a7bcb4d0c7807fcf42, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/d090c41738b44c27bf78f10b17307367, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/26e907182f9d44828361a7ac13865cb2, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/38d8e63ba3e6420495d58a58d42455e6, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/5f5c945badfc410293db4df11b64d505] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp, totalSize=26.6 K 2023-07-12 13:15:50,330 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting f31dcf52146744a7bcb4d0c7807fcf42, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167739496 2023-07-12 13:15:50,330 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting d090c41738b44c27bf78f10b17307367, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167741298 2023-07-12 13:15:50,330 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 26e907182f9d44828361a7ac13865cb2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167743118 2023-07-12 13:15:50,330 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 38d8e63ba3e6420495d58a58d42455e6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167744521 2023-07-12 13:15:50,331 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 5f5c945badfc410293db4df11b64d505, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-12 13:15:50,340 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): a34870d754173c6eb017e5976ddb69b1#family1#compaction#152 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:50,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/ce1e9160b8a3401e9bdd00dd98b1a5ef, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/f2ed1008d0374daeb73cdc559f20e9a7, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/9b32018128e84985a20e9608f76d9014, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/e5b33aa24d3741e692327a8be2e772c4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/43abada4b12b4ea79fdbfb650ccc9abc] to archive 2023-07-12 13:15:50,371 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:50,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/ce1e9160b8a3401e9bdd00dd98b1a5ef to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/ce1e9160b8a3401e9bdd00dd98b1a5ef 2023-07-12 13:15:50,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/f2ed1008d0374daeb73cdc559f20e9a7 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/f2ed1008d0374daeb73cdc559f20e9a7 2023-07-12 13:15:50,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/9b32018128e84985a20e9608f76d9014 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/9b32018128e84985a20e9608f76d9014 2023-07-12 13:15:50,381 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/e5b33aa24d3741e692327a8be2e772c4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/e5b33aa24d3741e692327a8be2e772c4 2023-07-12 13:15:50,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/43abada4b12b4ea79fdbfb650ccc9abc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family2/43abada4b12b4ea79fdbfb650ccc9abc 2023-07-12 13:15:50,749 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023071296ee7679281f46bc903a6664df54aa24_del 2023-07-12 13:15:50,749 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071296ee7679281f46bc903a6664df54aa24_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023071296ee7679281f46bc903a6664df54aa24_del 2023-07-12 13:15:51,562 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a604322e1204dc08ffb50828ba60688 2023-07-12 13:15:51,563 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family1/2a604322e1204dc08ffb50828ba60688 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/2a604322e1204dc08ffb50828ba60688 2023-07-12 13:15:51,567 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a604322e1204dc08ffb50828ba60688 2023-07-12 13:15:51,568 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a34870d754173c6eb017e5976ddb69b1/family1 of a34870d754173c6eb017e5976ddb69b1 into 2a604322e1204dc08ffb50828ba60688(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:15:51,568 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for a34870d754173c6eb017e5976ddb69b1: 2023-07-12 13:15:51,568 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:15:51,568 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): a34870d754173c6eb017e5976ddb69b1/family2 is initiating major compaction (all files) 2023-07-12 13:15:51,568 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:15:51,568 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:15:51,568 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of a34870d754173c6eb017e5976ddb69b1/family2 in ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:15:51,568 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/0d7e14af00ca4eeb893158f42a6836b5, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/bf8d2ef65ac74590a5123ac3e8221509, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/88b5d0f17b1b4c40b33774d784dda6b0, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/34f5915794e94ba58e48c3e656f156e1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/59ace3254fe14875b297a6bbd83727dc] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp, totalSize=25.3 K 2023-07-12 13:15:51,569 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 0d7e14af00ca4eeb893158f42a6836b5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167739496 2023-07-12 13:15:51,569 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting bf8d2ef65ac74590a5123ac3e8221509, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167741298 2023-07-12 13:15:51,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/f31dcf52146744a7bcb4d0c7807fcf42, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/d090c41738b44c27bf78f10b17307367, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/26e907182f9d44828361a7ac13865cb2, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/38d8e63ba3e6420495d58a58d42455e6, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/5f5c945badfc410293db4df11b64d505] to archive 2023-07-12 13:15:51,569 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 88b5d0f17b1b4c40b33774d784dda6b0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167743118 2023-07-12 13:15:51,570 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 34f5915794e94ba58e48c3e656f156e1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167744521 2023-07-12 13:15:51,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:51,570 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 59ace3254fe14875b297a6bbd83727dc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-12 13:15:51,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/f31dcf52146744a7bcb4d0c7807fcf42 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/f31dcf52146744a7bcb4d0c7807fcf42 2023-07-12 13:15:51,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/d090c41738b44c27bf78f10b17307367 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/d090c41738b44c27bf78f10b17307367 2023-07-12 13:15:51,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/26e907182f9d44828361a7ac13865cb2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/26e907182f9d44828361a7ac13865cb2 2023-07-12 13:15:51,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/38d8e63ba3e6420495d58a58d42455e6 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/38d8e63ba3e6420495d58a58d42455e6 2023-07-12 13:15:51,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/5f5c945badfc410293db4df11b64d505 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/5f5c945badfc410293db4df11b64d505 2023-07-12 13:15:51,577 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): a34870d754173c6eb017e5976ddb69b1#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:51,988 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230712935e947f75774d1eb939d2813cd47d7c_del 2023-07-12 13:15:51,988 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712935e947f75774d1eb939d2813cd47d7c_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230712935e947f75774d1eb939d2813cd47d7c_del 2023-07-12 13:15:52,803 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed69f64760a840eab96b69c550449bdc 2023-07-12 13:15:52,804 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/.tmp/family2/ed69f64760a840eab96b69c550449bdc as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/ed69f64760a840eab96b69c550449bdc 2023-07-12 13:15:52,807 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed69f64760a840eab96b69c550449bdc 2023-07-12 13:15:52,807 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a34870d754173c6eb017e5976ddb69b1/family2 of a34870d754173c6eb017e5976ddb69b1 into ed69f64760a840eab96b69c550449bdc(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:15:52,807 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for a34870d754173c6eb017e5976ddb69b1: 2023-07-12 13:15:52,808 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:15:52,808 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): 76d13adf9ec2fbd57aa0f03e10ecb66d/family1 is initiating major compaction (all files) 2023-07-12 13:15:52,808 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:15:52,808 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:15:52,808 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of 76d13adf9ec2fbd57aa0f03e10ecb66d/family1 in ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:52,808 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/60da30a069b84564b396e50c34fc0dad, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/a9edf2ce475848cfaefff92f0e392a0d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/8509142ec0ca4b45805e609df409b7c2, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/cc10b777be7848abb6c8e2edcbc28690, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/201a167fc2fa458691c8ad744a987c23] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp, totalSize=26.6 K 2023-07-12 13:15:52,808 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 60da30a069b84564b396e50c34fc0dad, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167739497 2023-07-12 13:15:52,809 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting a9edf2ce475848cfaefff92f0e392a0d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167741298 2023-07-12 13:15:52,809 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 8509142ec0ca4b45805e609df409b7c2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167743118 2023-07-12 13:15:52,810 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting cc10b777be7848abb6c8e2edcbc28690, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167744522 2023-07-12 13:15:52,810 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 201a167fc2fa458691c8ad744a987c23, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-12 13:15:52,819 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): 76d13adf9ec2fbd57aa0f03e10ecb66d#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:52,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/0d7e14af00ca4eeb893158f42a6836b5, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/bf8d2ef65ac74590a5123ac3e8221509, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/88b5d0f17b1b4c40b33774d784dda6b0, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/34f5915794e94ba58e48c3e656f156e1, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/59ace3254fe14875b297a6bbd83727dc] to archive 2023-07-12 13:15:52,871 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:52,873 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/0d7e14af00ca4eeb893158f42a6836b5 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/0d7e14af00ca4eeb893158f42a6836b5 2023-07-12 13:15:52,874 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/bf8d2ef65ac74590a5123ac3e8221509 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/bf8d2ef65ac74590a5123ac3e8221509 2023-07-12 13:15:52,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/88b5d0f17b1b4c40b33774d784dda6b0 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/88b5d0f17b1b4c40b33774d784dda6b0 2023-07-12 13:15:52,876 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/34f5915794e94ba58e48c3e656f156e1 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/34f5915794e94ba58e48c3e656f156e1 2023-07-12 13:15:52,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/59ace3254fe14875b297a6bbd83727dc to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family2/59ace3254fe14875b297a6bbd83727dc 2023-07-12 13:15:53,232 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230712e10c9b859c7f4366b385f1018c2fd7d0_del 2023-07-12 13:15:53,232 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712e10c9b859c7f4366b385f1018c2fd7d0_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230712e10c9b859c7f4366b385f1018c2fd7d0_del 2023-07-12 13:15:54,057 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41d77e9f7d0b4b919c3879a1c3a9e566 2023-07-12 13:15:54,059 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family1/41d77e9f7d0b4b919c3879a1c3a9e566 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/41d77e9f7d0b4b919c3879a1c3a9e566 2023-07-12 13:15:54,065 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41d77e9f7d0b4b919c3879a1c3a9e566 2023-07-12 13:15:54,067 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 76d13adf9ec2fbd57aa0f03e10ecb66d/family1 of 76d13adf9ec2fbd57aa0f03e10ecb66d into 41d77e9f7d0b4b919c3879a1c3a9e566(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:15:54,067 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for 76d13adf9ec2fbd57aa0f03e10ecb66d: 2023-07-12 13:15:54,067 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:15:54,067 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): 76d13adf9ec2fbd57aa0f03e10ecb66d/family2 is initiating major compaction (all files) 2023-07-12 13:15:54,067 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:15:54,067 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:15:54,067 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of 76d13adf9ec2fbd57aa0f03e10ecb66d/family2 in ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:15:54,068 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/488c5d003ced4f2b824589c69d775574, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/c680a176c68041198ac674547d3f2b4b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/b45bea23c59c4645ae8d8a5f26452b3e, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/293349f78d264f3ab16a6e02f91c5689, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/33983d8beb7942e1afa450f11549f1a0] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp, totalSize=25.3 K 2023-07-12 13:15:54,068 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 488c5d003ced4f2b824589c69d775574, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167739497 2023-07-12 13:15:54,069 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting c680a176c68041198ac674547d3f2b4b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167741298 2023-07-12 13:15:54,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/60da30a069b84564b396e50c34fc0dad, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/a9edf2ce475848cfaefff92f0e392a0d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/8509142ec0ca4b45805e609df409b7c2, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/cc10b777be7848abb6c8e2edcbc28690, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/201a167fc2fa458691c8ad744a987c23] to archive 2023-07-12 13:15:54,069 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting b45bea23c59c4645ae8d8a5f26452b3e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167743118 2023-07-12 13:15:54,070 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 293349f78d264f3ab16a6e02f91c5689, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167744522 2023-07-12 13:15:54,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:54,070 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 33983d8beb7942e1afa450f11549f1a0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-12 13:15:54,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/60da30a069b84564b396e50c34fc0dad to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/60da30a069b84564b396e50c34fc0dad 2023-07-12 13:15:54,075 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/a9edf2ce475848cfaefff92f0e392a0d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/a9edf2ce475848cfaefff92f0e392a0d 2023-07-12 13:15:54,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/8509142ec0ca4b45805e609df409b7c2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/8509142ec0ca4b45805e609df409b7c2 2023-07-12 13:15:54,078 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/cc10b777be7848abb6c8e2edcbc28690 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/cc10b777be7848abb6c8e2edcbc28690 2023-07-12 13:15:54,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/201a167fc2fa458691c8ad744a987c23 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/201a167fc2fa458691c8ad744a987c23 2023-07-12 13:15:54,084 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): 76d13adf9ec2fbd57aa0f03e10ecb66d#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:15:54,498 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230712317b50ec1ab04be5aa7f4cc354abe18e_del 2023-07-12 13:15:54,499 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712317b50ec1ab04be5aa7f4cc354abe18e_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230712317b50ec1ab04be5aa7f4cc354abe18e_del 2023-07-12 13:15:54,917 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 814c5bff53254088841d09630da62d0a 2023-07-12 13:15:54,918 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/.tmp/family2/814c5bff53254088841d09630da62d0a as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/814c5bff53254088841d09630da62d0a 2023-07-12 13:15:54,922 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 814c5bff53254088841d09630da62d0a 2023-07-12 13:15:54,923 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 76d13adf9ec2fbd57aa0f03e10ecb66d/family2 of 76d13adf9ec2fbd57aa0f03e10ecb66d into 814c5bff53254088841d09630da62d0a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:15:54,923 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for 76d13adf9ec2fbd57aa0f03e10ecb66d: 2023-07-12 13:15:54,926 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:54,929 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:54,932 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:54,933 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:54,937 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-12 13:15:54,950 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-07-12 13:15:54,952 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023071296ee7679281f46bc903a6664df54aa24_del 2023-07-12 13:15:54,955 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230712e10c9b859c7f4366b385f1018c2fd7d0_del 2023-07-12 13:15:54,958 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023071279557f03371f4c7b83386a11f22fa425_del 2023-07-12 13:15:54,958 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-07-12 13:15:54,958 DEBUG [Listener at localhost.localdomain/44505] zookeeper.ReadOnlyZKClient(139): Connect 0x07e09072 to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:15:54,962 DEBUG [Listener at localhost.localdomain/44505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45e567e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:15:54,963 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230712 for table='ns:testMinorCompaction' and column='family1' 2023-07-12 13:15:54,963 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230712 for table='ns:testMinorCompaction' and column='family1' 2023-07-12 13:15:54,963 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230712 for table='ns:testMinorCompaction' and column='family1' 2023-07-12 13:15:54,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/488c5d003ced4f2b824589c69d775574, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/c680a176c68041198ac674547d3f2b4b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/b45bea23c59c4645ae8d8a5f26452b3e, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/293349f78d264f3ab16a6e02f91c5689, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/33983d8beb7942e1afa450f11549f1a0] to archive 2023-07-12 13:15:54,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:54,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/488c5d003ced4f2b824589c69d775574 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/488c5d003ced4f2b824589c69d775574 2023-07-12 13:15:54,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/c680a176c68041198ac674547d3f2b4b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/c680a176c68041198ac674547d3f2b4b 2023-07-12 13:15:54,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/b45bea23c59c4645ae8d8a5f26452b3e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/b45bea23c59c4645ae8d8a5f26452b3e 2023-07-12 13:15:54,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/293349f78d264f3ab16a6e02f91c5689 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/293349f78d264f3ab16a6e02f91c5689 2023-07-12 13:15:54,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/33983d8beb7942e1afa450f11549f1a0 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family2/33983d8beb7942e1afa450f11549f1a0 2023-07-12 13:15:54,983 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071239ff24f2f2974e29933769d09709ae17 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023071239ff24f2f2974e29933769d09709ae17 2023-07-12 13:15:54,984 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230712 table='ns:testMinorCompaction' column='family1' 2023-07-12 13:15:54,996 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:15:54,998 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:15:55,004 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:15:55,007 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:15:55,031 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230712/family1/01768df9d8094008843bd6712f7039d3 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-07-12 13:15:55,032 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230712/family1/01768df9d8094008843bd6712f7039d3}] 2023-07-12 13:15:55,037 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230712/family1/01768df9d8094008843bd6712f7039d3 for inclusion in a34870d754173c6eb017e5976ddb69b1/family1 2023-07-12 13:15:55,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-07-12 13:15:55,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last=1 2023-07-12 13:15:55,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for a34870d754173c6eb017e5976ddb69b1: 2023-07-12 13:15:55,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230712/family1/01768df9d8094008843bd6712f7039d3 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__47v60q1j0kqkmabcqp1gpjo4950qs9pe2cvo9cvkk86gb0tc4bg40f1u6vcs71m2/family1/01768df9d8094008843bd6712f7039d3 2023-07-12 13:15:55,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__47v60q1j0kqkmabcqp1gpjo4950qs9pe2cvo9cvkk86gb0tc4bg40f1u6vcs71m2/family1/01768df9d8094008843bd6712f7039d3 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/54bf89f682cc40b4abc43990c79e6216_SeqId_28_ 2023-07-12 13:15:55,045 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__47v60q1j0kqkmabcqp1gpjo4950qs9pe2cvo9cvkk86gb0tc4bg40f1u6vcs71m2/family1/01768df9d8094008843bd6712f7039d3 into a34870d754173c6eb017e5976ddb69b1/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/54bf89f682cc40b4abc43990c79e6216_SeqId_28_ - updating store file list. 2023-07-12 13:15:55,049 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/54bf89f682cc40b4abc43990c79e6216_SeqId_28_ into a34870d754173c6eb017e5976ddb69b1/family1 2023-07-12 13:15:55,049 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__47v60q1j0kqkmabcqp1gpjo4950qs9pe2cvo9cvkk86gb0tc4bg40f1u6vcs71m2/family1/01768df9d8094008843bd6712f7039d3 into a34870d754173c6eb017e5976ddb69b1/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/family1/54bf89f682cc40b4abc43990c79e6216_SeqId_28_) 2023-07-12 13:15:55,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__47v60q1j0kqkmabcqp1gpjo4950qs9pe2cvo9cvkk86gb0tc4bg40f1u6vcs71m2/family1/01768df9d8094008843bd6712f7039d3 2023-07-12 13:15:55,051 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230712 table='ns:testMinorCompaction' column='family1' 2023-07-12 13:15:55,052 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:55,053 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202307125515863209904a88aeba6b8a186c71ea to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202307125515863209904a88aeba6b8a186c71ea 2023-07-12 13:15:55,053 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-07-12 13:15:55,053 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230712' 2023-07-12 13:15:55,054 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230712 for table='ns:testMinorCompaction' and column='family1' 2023-07-12 13:15:55,388 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712b054e6531dc64188afdd3b6243bad36a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230712b054e6531dc64188afdd3b6243bad36a 2023-07-12 13:15:55,389 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230712 table='ns:testMinorCompaction' column='family1' 2023-07-12 13:15:55,411 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230712/family1/b11211a27dd34da5b759da78f1daecc9 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-07-12 13:15:55,412 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230712/family1/b11211a27dd34da5b759da78f1daecc9}] 2023-07-12 13:15:55,413 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230712/family1/b11211a27dd34da5b759da78f1daecc9 for inclusion in d10e316608e6877e6e7709797b53ca2d/family1 2023-07-12 13:15:55,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-07-12 13:15:55,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-12 13:15:55,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for d10e316608e6877e6e7709797b53ca2d: 2023-07-12 13:15:55,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230712/family1/b11211a27dd34da5b759da78f1daecc9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__or49tf4kc61u2g34jggd17deaoml27g2s4imuv9r4652j9r12qek91m36uffmgrb/family1/b11211a27dd34da5b759da78f1daecc9 2023-07-12 13:15:55,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__or49tf4kc61u2g34jggd17deaoml27g2s4imuv9r4652j9r12qek91m36uffmgrb/family1/b11211a27dd34da5b759da78f1daecc9 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/3a488765347143bab2a960d9884f4780_SeqId_28_ 2023-07-12 13:15:55,418 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__or49tf4kc61u2g34jggd17deaoml27g2s4imuv9r4652j9r12qek91m36uffmgrb/family1/b11211a27dd34da5b759da78f1daecc9 into d10e316608e6877e6e7709797b53ca2d/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/3a488765347143bab2a960d9884f4780_SeqId_28_ - updating store file list. 2023-07-12 13:15:55,420 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/3a488765347143bab2a960d9884f4780_SeqId_28_ into d10e316608e6877e6e7709797b53ca2d/family1 2023-07-12 13:15:55,420 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__or49tf4kc61u2g34jggd17deaoml27g2s4imuv9r4652j9r12qek91m36uffmgrb/family1/b11211a27dd34da5b759da78f1daecc9 into d10e316608e6877e6e7709797b53ca2d/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/family1/3a488765347143bab2a960d9884f4780_SeqId_28_) 2023-07-12 13:15:55,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__or49tf4kc61u2g34jggd17deaoml27g2s4imuv9r4652j9r12qek91m36uffmgrb/family1/b11211a27dd34da5b759da78f1daecc9 2023-07-12 13:15:55,422 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230712 table='ns:testMinorCompaction' column='family1' 2023-07-12 13:15:55,423 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:55,424 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202307128c8ffab5580f4e819144dde120b9cfe0 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202307128c8ffab5580f4e819144dde120b9cfe0 2023-07-12 13:15:55,424 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-07-12 13:15:55,424 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230712' 2023-07-12 13:15:55,425 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230712 for table='ns:testMinorCompaction' and column='family1' 2023-07-12 13:15:55,790 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712dec0103bc7f642bf9552cba5070e6140 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230712dec0103bc7f642bf9552cba5070e6140 2023-07-12 13:15:55,792 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230712 table='ns:testMinorCompaction' column='family1' 2023-07-12 13:15:55,816 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230712/family1/dc4cb58fd4454b4bb316b7702b277c46 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-07-12 13:15:55,817 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230712/family1/dc4cb58fd4454b4bb316b7702b277c46}] 2023-07-12 13:15:55,819 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230712/family1/dc4cb58fd4454b4bb316b7702b277c46 for inclusion in 76d13adf9ec2fbd57aa0f03e10ecb66d/family1 2023-07-12 13:15:55,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-07-12 13:15:55,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(777): Region bounds: first=1 last=2 2023-07-12 13:15:55,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for 76d13adf9ec2fbd57aa0f03e10ecb66d: 2023-07-12 13:15:55,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230712/family1/dc4cb58fd4454b4bb316b7702b277c46 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__pvpe970qqvc9ce0bfp4g772p9kg2upc3fgdhlfnbtc0ui8m3kbp41off6kv5h6ef/family1/dc4cb58fd4454b4bb316b7702b277c46 2023-07-12 13:15:55,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__pvpe970qqvc9ce0bfp4g772p9kg2upc3fgdhlfnbtc0ui8m3kbp41off6kv5h6ef/family1/dc4cb58fd4454b4bb316b7702b277c46 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/81086be9f6ec4e92880feca80430fcfb_SeqId_28_ 2023-07-12 13:15:55,824 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__pvpe970qqvc9ce0bfp4g772p9kg2upc3fgdhlfnbtc0ui8m3kbp41off6kv5h6ef/family1/dc4cb58fd4454b4bb316b7702b277c46 into 76d13adf9ec2fbd57aa0f03e10ecb66d/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/81086be9f6ec4e92880feca80430fcfb_SeqId_28_ - updating store file list. 2023-07-12 13:15:55,826 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/81086be9f6ec4e92880feca80430fcfb_SeqId_28_ into 76d13adf9ec2fbd57aa0f03e10ecb66d/family1 2023-07-12 13:15:55,826 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__pvpe970qqvc9ce0bfp4g772p9kg2upc3fgdhlfnbtc0ui8m3kbp41off6kv5h6ef/family1/dc4cb58fd4454b4bb316b7702b277c46 into 76d13adf9ec2fbd57aa0f03e10ecb66d/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/family1/81086be9f6ec4e92880feca80430fcfb_SeqId_28_) 2023-07-12 13:15:55,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__ns_testMinorCompaction__pvpe970qqvc9ce0bfp4g772p9kg2upc3fgdhlfnbtc0ui8m3kbp41off6kv5h6ef/family1/dc4cb58fd4454b4bb316b7702b277c46 2023-07-12 13:15:55,828 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230712 table='ns:testMinorCompaction' column='family1' 2023-07-12 13:15:55,829 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:15:55,830 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023071202e4b6b06f494eaaae342a4d726e3211 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023071202e4b6b06f494eaaae342a4d726e3211 2023-07-12 13:15:55,830 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-07-12 13:15:55,830 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230712' 2023-07-12 13:15:55,830 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230712 for table='ns:testMinorCompaction' and column='family1' 2023-07-12 13:15:55,830 INFO [Listener at localhost.localdomain/44505] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-07-12 13:15:55,832 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:55,834 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:55,836 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:15:55,837 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:15:55,850 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=256 (was 287), OpenFileDescriptor=649 (was 765), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=131 (was 144), ProcessCount=166 (was 166), AvailableMemoryMB=7818 (was 7603) - AvailableMemoryMB LEAK? - 2023-07-12 13:15:55,863 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=256, OpenFileDescriptor=649, MaxFileDescriptor=60000, SystemLoadAverage=131, ProcessCount=166, AvailableMemoryMB=7817 2023-07-12 13:15:55,865 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-12 13:15:55,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:55,867 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:15:55,868 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-07-12 13:15:55,868 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:15:55,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-12 13:15:55,870 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6 2023-07-12 13:15:55,870 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6 empty. 2023-07-12 13:15:55,871 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6 2023-07-12 13:15:55,871 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-07-12 13:15:55,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-12 13:15:56,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-12 13:15:56,282 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-07-12 13:15:56,286 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => d615b79ac3c7ed8fb72118637ae048e6, NAME => 'testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:15:56,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-12 13:15:56,693 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:56,693 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing d615b79ac3c7ed8fb72118637ae048e6, disabling compactions & flushes 2023-07-12 13:15:56,694 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:15:56,694 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:15:56,694 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. after waiting 0 ms 2023-07-12 13:15:56,694 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:15:56,694 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:15:56,694 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:15:56,696 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:15:56,697 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689167756696"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167756696"}]},"ts":"1689167756696"} 2023-07-12 13:15:56,698 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 13:15:56,699 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:15:56,699 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167756699"}]},"ts":"1689167756699"} 2023-07-12 13:15:56,700 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-07-12 13:15:56,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=d615b79ac3c7ed8fb72118637ae048e6, ASSIGN}] 2023-07-12 13:15:56,704 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=d615b79ac3c7ed8fb72118637ae048e6, ASSIGN 2023-07-12 13:15:56,704 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=d615b79ac3c7ed8fb72118637ae048e6, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:15:56,856 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=d615b79ac3c7ed8fb72118637ae048e6, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:56,856 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689167756856"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167756856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167756856"}]},"ts":"1689167756856"} 2023-07-12 13:15:56,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure d615b79ac3c7ed8fb72118637ae048e6, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:15:56,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-12 13:15:57,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:15:57,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d615b79ac3c7ed8fb72118637ae048e6, NAME => 'testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:15:57,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy d615b79ac3c7ed8fb72118637ae048e6 2023-07-12 13:15:57,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:15:57,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for d615b79ac3c7ed8fb72118637ae048e6 2023-07-12 13:15:57,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for d615b79ac3c7ed8fb72118637ae048e6 2023-07-12 13:15:57,021 INFO [StoreOpener-d615b79ac3c7ed8fb72118637ae048e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d615b79ac3c7ed8fb72118637ae048e6 2023-07-12 13:15:57,023 DEBUG [StoreOpener-d615b79ac3c7ed8fb72118637ae048e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1 2023-07-12 13:15:57,023 DEBUG [StoreOpener-d615b79ac3c7ed8fb72118637ae048e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1 2023-07-12 13:15:57,024 INFO [StoreOpener-d615b79ac3c7ed8fb72118637ae048e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d615b79ac3c7ed8fb72118637ae048e6 columnFamilyName family1 2023-07-12 13:15:57,025 INFO [StoreOpener-d615b79ac3c7ed8fb72118637ae048e6-1] regionserver.HStore(310): Store=d615b79ac3c7ed8fb72118637ae048e6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:15:57,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6 2023-07-12 13:15:57,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6 2023-07-12 13:15:57,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for d615b79ac3c7ed8fb72118637ae048e6 2023-07-12 13:15:57,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:15:57,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened d615b79ac3c7ed8fb72118637ae048e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59213079, jitterRate=-0.11765636503696442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:15:57,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:15:57,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6., pid=114, masterSystemTime=1689167757012 2023-07-12 13:15:57,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:15:57,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:15:57,032 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=d615b79ac3c7ed8fb72118637ae048e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:57,032 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689167757032"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167757032"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167757032"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167757032"}]},"ts":"1689167757032"} 2023-07-12 13:15:57,035 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-07-12 13:15:57,035 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure d615b79ac3c7ed8fb72118637ae048e6, server=jenkins-hbase17.apache.org,41721,1689167613545 in 175 msec 2023-07-12 13:15:57,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-07-12 13:15:57,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=d615b79ac3c7ed8fb72118637ae048e6, ASSIGN in 333 msec 2023-07-12 13:15:57,037 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:15:57,037 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167757037"}]},"ts":"1689167757037"} 2023-07-12 13:15:57,038 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-07-12 13:15:57,118 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:15:57,121 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.2530 sec 2023-07-12 13:15:57,776 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:15:57,776 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x368a380b to 127.0.0.1:51470 2023-07-12 13:15:57,776 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:15:57,790 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:15:57,790 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x612e9a20 to 127.0.0.1:51470 2023-07-12 13:15:57,790 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:15:57,790 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:15:57,791 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07e09072 to 127.0.0.1:51470 2023-07-12 13:15:57,791 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:15:57,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-12 13:15:57,978 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-07-12 13:15:58,003 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:15:58,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,008 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:15:58,008 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:58,008 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:15:58,009 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:15:58,009 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,009 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,010 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:58,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:58,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:58,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,011 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:15:58,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,012 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,012 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,012 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:15:58,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,016 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:15:58,016 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:58,016 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:15:58,017 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:15:58,017 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:15:58,018 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:15:58,018 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. started... 2023-07-12 13:15:58,019 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d615b79ac3c7ed8fb72118637ae048e6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-12 13:15:58,075 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113063ef67d3f6c04f6bbba2bf88fc16002c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113063ef67d3f6c04f6bbba2bf88fc16002c 2023-07-12 13:15:58,079 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/45a15ff5965d41da870b9f1b3d1f864d 2023-07-12 13:15:58,083 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/45a15ff5965d41da870b9f1b3d1f864d as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/45a15ff5965d41da870b9f1b3d1f864d 2023-07-12 13:15:58,089 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/45a15ff5965d41da870b9f1b3d1f864d, entries=1000, sequenceid=5, filesize=166.0 K 2023-07-12 13:15:58,090 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for d615b79ac3c7ed8fb72118637ae048e6 in 71ms, sequenceid=5, compaction requested=false 2023-07-12 13:15:58,090 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:15:58,091 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:15:58,091 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:15:58,091 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:15:58,091 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:15:58,091 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,091 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:15:58,091 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:15:58,093 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,093 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:58,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:58,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:58,093 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,094 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:15:58,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:58,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:58,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:15:58,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54874ddf[Count = 0] remaining members to acquire global barrier 2023-07-12 13:15:58,096 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:15:58,096 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,097 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,097 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:15:58,097 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:15:58,097 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:15:58,098 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,098 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:15:58,099 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:15:58,099 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:58,099 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:15:58,099 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:58,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:58,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:58,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:58,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:58,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:15:58,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:15:58,106 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:15:58,106 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:15:58,106 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:15:58,106 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,106 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:15:58,107 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,107 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:58,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:58,108 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:58,111 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:58,113 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:58,116 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:58,116 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:58,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:58,116 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:58,116 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:15:58,116 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:15:58,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:58,117 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,117 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:15:58,117 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,117 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:58,117 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:15:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:58,117 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,117 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,117 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,117 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-12 13:15:58,217 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:15:58,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:15:58,223 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:15:58,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:15:58,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,224 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:15:58,224 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:58,224 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:15:58,224 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:15:58,225 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,225 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,226 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,226 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:58,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:58,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:58,226 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:58,226 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:15:58,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:15:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,227 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,227 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:15:58,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:58,227 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:15:58,227 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:58,227 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:15:58,227 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:15:58,227 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:15:58,227 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:15:58,227 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. started... 2023-07-12 13:15:58,227 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d615b79ac3c7ed8fb72118637ae048e6 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-12 13:15:58,643 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128bb2d6026bdba4f93b5f6a0d5345aeb04 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128bb2d6026bdba4f93b5f6a0d5345aeb04 2023-07-12 13:15:59,053 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/4457430f9e6443afa1f5239a60e305e5 2023-07-12 13:15:59,060 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/4457430f9e6443afa1f5239a60e305e5 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/4457430f9e6443afa1f5239a60e305e5 2023-07-12 13:15:59,068 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/4457430f9e6443afa1f5239a60e305e5, entries=1, sequenceid=9, filesize=5.0 K 2023-07-12 13:15:59,069 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for d615b79ac3c7ed8fb72118637ae048e6 in 842ms, sequenceid=9, compaction requested=false 2023-07-12 13:15:59,069 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:15:59,069 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:15:59,069 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:15:59,070 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:15:59,070 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,070 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:15:59,070 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:15:59,071 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,071 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:59,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:59,072 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,072 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:15:59,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:59,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:59,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:59,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:15:59,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a062af8[Count = 0] remaining members to acquire global barrier 2023-07-12 13:15:59,075 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:15:59,075 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,076 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,077 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:15:59,077 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:15:59,077 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:15:59,077 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,077 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:15:59,078 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:15:59,078 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,078 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:59,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:59,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:59,078 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:15:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:59,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:59,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:15:59,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:15:59,082 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:15:59,082 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:15:59,083 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:15:59,083 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,083 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:15:59,084 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:15:59,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:15:59,084 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,084 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:59,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:15:59,085 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:15:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,086 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:15:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,089 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,090 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:59,090 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:59,090 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:15:59,090 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:15:59,090 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:15:59,090 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:15:59,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:59,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-12 13:15:59,090 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:15:59,090 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,090 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:15:59,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:15:59,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:15:59,090 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,090 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,090 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,091 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,190 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:15:59,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:15:59,195 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:15:59,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:15:59,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,196 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:15:59,196 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:59,196 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:15:59,197 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:15:59,197 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,197 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,198 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:15:59,198 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:15:59,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:15:59,198 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:15:59,198 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:15:59,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:15:59,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,199 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,199 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:15:59,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:15:59,199 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:15:59,199 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:15:59,199 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:15:59,199 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:15:59,199 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:15:59,199 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:15:59,199 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. started... 2023-07-12 13:15:59,200 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d615b79ac3c7ed8fb72118637ae048e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:15:59,614 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201865afaee10f843b591fd25ce54cd3954 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201865afaee10f843b591fd25ce54cd3954 2023-07-12 13:16:00,022 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/5554624f5ac14e9aa5ee8fbb33e96f90 2023-07-12 13:16:00,028 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/5554624f5ac14e9aa5ee8fbb33e96f90 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/5554624f5ac14e9aa5ee8fbb33e96f90 2023-07-12 13:16:00,032 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/5554624f5ac14e9aa5ee8fbb33e96f90, entries=1, sequenceid=13, filesize=4.9 K 2023-07-12 13:16:00,032 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d615b79ac3c7ed8fb72118637ae048e6 in 832ms, sequenceid=13, compaction requested=true 2023-07-12 13:16:00,032 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:16:00,032 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:00,032 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:16:00,033 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:16:00,033 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,033 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:16:00,033 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:16:00,034 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:00,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:00,034 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:00,034 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,034 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:16:00,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:00,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:00,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:16:00,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f1e9893[Count = 0] remaining members to acquire global barrier 2023-07-12 13:16:00,036 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:16:00,036 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,036 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,037 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:16:00,037 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:16:00,037 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,037 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:16:00,037 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:16:00,038 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:16:00,038 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,038 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:00,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:00,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:00,038 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:16:00,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:00,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:00,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:16:00,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:16:00,041 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:16:00,041 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:16:00,041 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:16:00,041 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,041 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:16:00,042 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,042 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,042 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:00,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:00,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:00,043 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:00,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,044 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:00,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,046 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,046 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:00,046 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,046 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:00,046 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,046 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:00,047 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:16:00,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:00,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:00,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-12 13:16:00,046 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:00,047 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,047 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:16:00,047 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:16:00,047 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:00,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:00,047 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,047 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,147 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:16:00,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:16:00,152 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:16:00,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:16:00,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,153 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:00,154 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:00,154 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:16:00,154 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:16:00,154 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,154 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,155 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,155 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:00,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:00,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:00,155 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,155 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:16:00,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:16:00,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,156 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,156 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:16:00,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,156 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:16:00,156 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:00,156 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:16:00,156 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:16:00,156 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:16:00,156 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:00,156 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. started... 2023-07-12 13:16:00,156 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d615b79ac3c7ed8fb72118637ae048e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:16:00,571 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057afa5c4e80d1483cb3ea432e3c9d85d3 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512057afa5c4e80d1483cb3ea432e3c9d85d3 2023-07-12 13:16:00,581 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/6978bf567bf64259ab3811cac45d5b80 2023-07-12 13:16:00,585 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/6978bf567bf64259ab3811cac45d5b80 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/6978bf567bf64259ab3811cac45d5b80 2023-07-12 13:16:00,589 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/6978bf567bf64259ab3811cac45d5b80, entries=1, sequenceid=17, filesize=4.9 K 2023-07-12 13:16:00,590 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d615b79ac3c7ed8fb72118637ae048e6 in 434ms, sequenceid=17, compaction requested=true 2023-07-12 13:16:00,590 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:16:00,590 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:00,590 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:16:00,590 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:16:00,590 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,590 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:16:00,590 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:16:00,592 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,592 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:00,592 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,592 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:16:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:00,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:00,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:16:00,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ed528d3[Count = 0] remaining members to acquire global barrier 2023-07-12 13:16:00,594 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:16:00,594 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,594 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,595 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:16:00,595 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:16:00,595 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:16:00,595 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,595 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:16:00,596 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:16:00,596 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,596 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:00,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:00,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:00,596 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:16:00,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:16:00,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:16:00,599 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:16:00,600 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:16:00,600 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:16:00,600 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,600 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:16:00,601 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,601 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,601 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:00,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:00,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:00,602 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,603 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,606 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,606 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:00,606 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:00,606 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:00,606 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:00,606 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:16:00,606 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:00,606 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:00,606 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,607 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:16:00,607 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,607 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:16:00,607 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,607 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,707 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:16:00,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:16:00,714 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:16:00,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:16:00,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,717 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:00,717 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:00,717 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:16:00,717 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:16:00,718 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,718 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,719 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:00,719 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:00,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:00,720 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:00,720 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:16:00,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:16:00,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,723 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,723 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:16:00,723 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:00,723 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:16:00,724 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:00,724 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:16:00,724 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:16:00,724 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:16:00,724 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:00,724 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. started... 2023-07-12 13:16:00,724 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d615b79ac3c7ed8fb72118637ae048e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:16:01,145 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512284b190afc06a44556b1340255c8327ba9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512284b190afc06a44556b1340255c8327ba9 2023-07-12 13:16:01,552 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/872a5514485b4ed3baec739c78018894 2023-07-12 13:16:01,560 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/872a5514485b4ed3baec739c78018894 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/872a5514485b4ed3baec739c78018894 2023-07-12 13:16:01,568 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/872a5514485b4ed3baec739c78018894, entries=1, sequenceid=21, filesize=4.9 K 2023-07-12 13:16:01,569 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d615b79ac3c7ed8fb72118637ae048e6 in 845ms, sequenceid=21, compaction requested=true 2023-07-12 13:16:01,569 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:16:01,569 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:01,569 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:16:01,569 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:16:01,569 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,569 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:16:01,569 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:16:01,570 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,570 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:01,571 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,571 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:16:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:01,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:16:01,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20d27d63[Count = 0] remaining members to acquire global barrier 2023-07-12 13:16:01,572 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:16:01,572 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,572 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,573 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:16:01,573 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:16:01,573 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:16:01,573 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,573 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:16:01,573 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:16:01,573 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:01,573 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,574 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:16:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:01,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:16:01,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:16:01,576 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:16:01,576 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:16:01,576 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:16:01,576 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,576 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:16:01,577 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,577 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:01,577 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:01,578 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,579 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:01,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,581 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,581 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,581 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:01,581 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:01,581 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:01,581 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:16:01,581 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,581 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:01,581 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:01,581 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:01,581 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:16:01,581 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,582 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:16:01,582 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:01,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:01,682 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:16:01,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:16:01,688 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:16:01,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:16:01,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,690 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:01,690 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:01,690 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:16:01,690 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:16:01,691 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,691 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,692 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:01,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:01,692 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:01,692 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:01,692 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:16:01,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:16:01,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,694 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,695 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:16:01,695 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:01,695 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:16:01,695 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:01,695 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:16:01,696 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:16:01,696 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:16:01,696 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:01,696 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. started... 2023-07-12 13:16:01,696 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d615b79ac3c7ed8fb72118637ae048e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:16:01,710 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231393f93ec41874976a3096b9baf28cfeb to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231393f93ec41874976a3096b9baf28cfeb 2023-07-12 13:16:02,116 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/6710aa74b2fe4540a21eb24bd1dffebe 2023-07-12 13:16:02,121 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/6710aa74b2fe4540a21eb24bd1dffebe as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/6710aa74b2fe4540a21eb24bd1dffebe 2023-07-12 13:16:02,125 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/6710aa74b2fe4540a21eb24bd1dffebe, entries=1, sequenceid=25, filesize=4.9 K 2023-07-12 13:16:02,126 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d615b79ac3c7ed8fb72118637ae048e6 in 430ms, sequenceid=25, compaction requested=true 2023-07-12 13:16:02,126 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:16:02,126 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:02,126 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:16:02,126 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:16:02,126 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,126 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:16:02,126 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:16:02,127 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,127 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:02,128 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,128 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:16:02,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:02,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:02,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:02,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:16:02,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b68d26b[Count = 0] remaining members to acquire global barrier 2023-07-12 13:16:02,130 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:16:02,130 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,131 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,131 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:16:02,131 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:16:02,131 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:16:02,131 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,131 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:16:02,132 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,132 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:16:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:02,132 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:02,132 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:16:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:02,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:16:02,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:16:02,136 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:16:02,136 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:16:02,136 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:16:02,136 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,136 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:16:02,137 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,137 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:02,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:02,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,137 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:02,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:02,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:02,138 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:02,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:02,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,140 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,142 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,142 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,142 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:02,142 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,142 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:02,142 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:16:02,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:02,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:02,142 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:02,143 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:16:02,142 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:02,143 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:16:02,142 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:02,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:02,143 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,143 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,143 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,243 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:16:02,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:16:02,253 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:16:02,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:16:02,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,255 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:02,255 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:02,255 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:16:02,255 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:16:02,256 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,256 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,257 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:02,257 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:02,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:02,258 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:02,258 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:16:02,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:16:02,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,259 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,260 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:16:02,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:02,260 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:16:02,260 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:02,260 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:16:02,260 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:16:02,260 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:16:02,260 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:02,260 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. started... 2023-07-12 13:16:02,260 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d615b79ac3c7ed8fb72118637ae048e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:16:02,558 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 13:16:02,673 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601011414a0c3840f4500bf6815a2248a8547 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601011414a0c3840f4500bf6815a2248a8547 2023-07-12 13:16:03,081 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/b9a4c4fd838d4d1cb9fb4a42dd43e300 2023-07-12 13:16:03,089 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/b9a4c4fd838d4d1cb9fb4a42dd43e300 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/b9a4c4fd838d4d1cb9fb4a42dd43e300 2023-07-12 13:16:03,097 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/b9a4c4fd838d4d1cb9fb4a42dd43e300, entries=1, sequenceid=29, filesize=4.9 K 2023-07-12 13:16:03,098 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d615b79ac3c7ed8fb72118637ae048e6 in 838ms, sequenceid=29, compaction requested=true 2023-07-12 13:16:03,098 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:16:03,098 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:03,098 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:16:03,098 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:16:03,098 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,098 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:16:03,098 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:16:03,156 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,156 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:03,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:03,157 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,157 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:16:03,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:03,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:03,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:03,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:16:03,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30c90195[Count = 0] remaining members to acquire global barrier 2023-07-12 13:16:03,160 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:16:03,160 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,166 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,166 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:16:03,166 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:16:03,166 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,167 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:16:03,167 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:16:03,168 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:16:03,168 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,168 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:03,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:03,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:03,168 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:16:03,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:03,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:03,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:03,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:16:03,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:16:03,171 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:16:03,171 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:16:03,171 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:16:03,171 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,171 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:16:03,172 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,172 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:03,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:03,172 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:03,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,173 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:03,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:03,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:03,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:03,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,174 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:03,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,175 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:03,175 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,175 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:03,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:03,175 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:03,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-12 13:16:03,175 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:16:03,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:03,175 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:03,175 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,175 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:16:03,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:03,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:03,175 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,175 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:16:03,175 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,176 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,176 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,176 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,276 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:16:03,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:16:03,280 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:16:03,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:16:03,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,282 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:03,282 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:03,282 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:16:03,282 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:16:03,283 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,283 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,284 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:03,284 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:03,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:03,284 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,284 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:16:03,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:16:03,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,285 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,285 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:16:03,286 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,286 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:16:03,286 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:03,286 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:16:03,286 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:16:03,286 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:16:03,286 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:03,286 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. started... 2023-07-12 13:16:03,286 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d615b79ac3c7ed8fb72118637ae048e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:16:03,697 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b7f549ab173c4110b11c92a6f0eec784 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b7f549ab173c4110b11c92a6f0eec784 2023-07-12 13:16:03,703 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/a75f984a44b042d9be519c79466269ea 2023-07-12 13:16:03,708 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/a75f984a44b042d9be519c79466269ea as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/a75f984a44b042d9be519c79466269ea 2023-07-12 13:16:03,712 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/a75f984a44b042d9be519c79466269ea, entries=1, sequenceid=33, filesize=4.9 K 2023-07-12 13:16:03,713 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d615b79ac3c7ed8fb72118637ae048e6 in 427ms, sequenceid=33, compaction requested=true 2023-07-12 13:16:03,713 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:16:03,713 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:03,714 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:16:03,714 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:16:03,714 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,714 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:16:03,714 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:16:03,715 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,716 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:03,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:03,716 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,716 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:16:03,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:03,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:03,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:03,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:16:03,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57bd24ef[Count = 0] remaining members to acquire global barrier 2023-07-12 13:16:03,722 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:16:03,723 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,723 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,724 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:16:03,724 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:16:03,724 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:16:03,724 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,724 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:16:03,726 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,726 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:16:03,726 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:03,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:03,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:03,726 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:16:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:03,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:03,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:16:03,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:16:03,733 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:16:03,734 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:16:03,734 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:16:03,734 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,734 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:16:03,735 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,735 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,735 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:03,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:03,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:03,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:03,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:03,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:03,735 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:03,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,736 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:03,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,738 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,738 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,738 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,738 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,738 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,738 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:03,738 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:16:03,738 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:03,738 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,738 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,738 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:03,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:03,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:03,738 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:16:03,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-12 13:16:03,738 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:03,738 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:16:03,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:03,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:03,838 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:16:03,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:16:03,849 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:16:03,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:16:03,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,852 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:03,852 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:03,853 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:16:03,853 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:16:03,854 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,854 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,855 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:03,855 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:03,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:03,856 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:03,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,856 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:16:03,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:16:03,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,858 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,858 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:16:03,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:03,859 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:16:03,859 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:03,859 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:16:03,859 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:16:03,859 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:16:03,859 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:03,859 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. started... 2023-07-12 13:16:03,860 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d615b79ac3c7ed8fb72118637ae048e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:16:04,286 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090759eeba3d02b549d386ecfab7213a8db0 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090759eeba3d02b549d386ecfab7213a8db0 2023-07-12 13:16:04,693 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/2e20d4473476483e944c79d2181fbc64 2023-07-12 13:16:04,701 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/2e20d4473476483e944c79d2181fbc64 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/2e20d4473476483e944c79d2181fbc64 2023-07-12 13:16:04,707 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/2e20d4473476483e944c79d2181fbc64, entries=1, sequenceid=37, filesize=4.9 K 2023-07-12 13:16:04,708 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d615b79ac3c7ed8fb72118637ae048e6 in 848ms, sequenceid=37, compaction requested=true 2023-07-12 13:16:04,708 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:16:04,708 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:04,708 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:16:04,708 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:16:04,708 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,708 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:16:04,708 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:16:04,710 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,710 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:04,710 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,711 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:16:04,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:04,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:04,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:04,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:16:04,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64b7621e[Count = 0] remaining members to acquire global barrier 2023-07-12 13:16:04,713 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:16:04,713 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,714 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,715 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:16:04,715 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:16:04,715 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,715 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:16:04,715 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:16:04,716 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,716 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:16:04,716 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:04,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:04,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:04,716 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:16:04,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:04,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:04,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:04,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:16:04,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:16:04,720 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:16:04,720 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:16:04,720 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:16:04,720 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,720 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:16:04,722 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,722 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:04,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:04,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,722 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:04,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:04,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:04,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:04,723 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:04,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,725 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:04,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,727 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,727 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:04,727 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:04,727 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,727 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:04,727 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:16:04,727 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,728 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,727 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:04,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:04,728 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:16:04,728 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:16:04,728 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:04,728 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,728 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:04,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:04,828 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:16:04,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:16:04,836 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:16:04,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-12 13:16:04,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,839 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:04,839 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:04,839 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-12 13:16:04,839 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-12 13:16:04,840 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,840 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,842 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:04,842 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:04,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:04,843 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:04,843 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:16:04,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:16:04,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,845 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,845 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-12 13:16:04,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:04,846 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-12 13:16:04,846 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:04,846 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-12 13:16:04,846 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 13:16:04,846 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:16:04,846 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:04,847 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. started... 2023-07-12 13:16:04,847 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d615b79ac3c7ed8fb72118637ae048e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-12 13:16:05,265 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511207a0d6abff4d14ecb897bda5da81a649b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511207a0d6abff4d14ecb897bda5da81a649b 2023-07-12 13:16:05,675 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/95b98d034112468582ee118861b3d84c 2023-07-12 13:16:05,680 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/95b98d034112468582ee118861b3d84c as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/95b98d034112468582ee118861b3d84c 2023-07-12 13:16:05,685 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/95b98d034112468582ee118861b3d84c, entries=1, sequenceid=41, filesize=4.9 K 2023-07-12 13:16:05,686 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d615b79ac3c7ed8fb72118637ae048e6 in 839ms, sequenceid=41, compaction requested=true 2023-07-12 13:16:05,686 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:16:05,686 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:05,686 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 13:16:05,686 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 13:16:05,686 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,686 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-12 13:16:05,686 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-12 13:16:05,688 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,688 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:05,688 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,688 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:16:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:05,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:05,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:05,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-12 13:16:05,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69410f69[Count = 0] remaining members to acquire global barrier 2023-07-12 13:16:05,691 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-12 13:16:05,691 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,691 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,692 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-12 13:16:05,692 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-12 13:16:05,692 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:16:05,692 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,692 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:16:05,693 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-12 13:16:05,693 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,693 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:05,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,693 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-12 13:16:05,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:05,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:05,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:05,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:05,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:16:05,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-12 13:16:05,697 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-12 13:16:05,697 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:16:05,697 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:16:05,697 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,697 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:16:05,699 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,699 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:05,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:05,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,699 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:05,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:05,700 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:05,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:05,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:05,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,702 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,704 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,704 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:05,704 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:05,704 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,704 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,705 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:05,704 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-12 13:16:05,705 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:16:05,704 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:05,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:05,705 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:05,705 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-12 13:16:05,705 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:16:05,705 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,705 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:05,805 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:16:05,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:16:05,807 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-07-12 13:16:05,809 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-12 13:16:05,810 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-12 13:16:05,810 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:16:05,810 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168365810 2023-07-12 13:16:05,815 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-12 13:16:05,816 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-07-12 13:16:05,816 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:16:05,816 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x2b0809e2 to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:16:05,828 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ab6cb9a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:16:05,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:16:06,672 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e96df1ddff38496bbdf0558a1914f270 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103e96df1ddff38496bbdf0558a1914f270 2023-07-12 13:16:06,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:16:06,686 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:16:06,688 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:49212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:16:06,693 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:16:06,694 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:16:06,705 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/573ac736c4d04740a52a235904ae2999 first=Optional[r5] last=Optional[r6] 2023-07-12 13:16:06,706 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/573ac736c4d04740a52a235904ae2999}] 2023-07-12 13:16:06,711 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/573ac736c4d04740a52a235904ae2999 for inclusion in d615b79ac3c7ed8fb72118637ae048e6/family1 2023-07-12 13:16:06,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-07-12 13:16:06,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:16:06,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:16:06,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/573ac736c4d04740a52a235904ae2999 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__rr882j4n6koh6l7k00lu70tflg35ofrsnrcblr7b8m373kt09lebuvgf4ql8t3ma/family1/573ac736c4d04740a52a235904ae2999 2023-07-12 13:16:06,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__rr882j4n6koh6l7k00lu70tflg35ofrsnrcblr7b8m373kt09lebuvgf4ql8t3ma/family1/573ac736c4d04740a52a235904ae2999 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/ea8ed4a7d0294fd7a280a717e6a7dbcd_SeqId_44_ 2023-07-12 13:16:06,716 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__rr882j4n6koh6l7k00lu70tflg35ofrsnrcblr7b8m373kt09lebuvgf4ql8t3ma/family1/573ac736c4d04740a52a235904ae2999 into d615b79ac3c7ed8fb72118637ae048e6/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/ea8ed4a7d0294fd7a280a717e6a7dbcd_SeqId_44_ - updating store file list. 2023-07-12 13:16:06,719 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/ea8ed4a7d0294fd7a280a717e6a7dbcd_SeqId_44_ into d615b79ac3c7ed8fb72118637ae048e6/family1 2023-07-12 13:16:06,719 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__rr882j4n6koh6l7k00lu70tflg35ofrsnrcblr7b8m373kt09lebuvgf4ql8t3ma/family1/573ac736c4d04740a52a235904ae2999 into d615b79ac3c7ed8fb72118637ae048e6/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/ea8ed4a7d0294fd7a280a717e6a7dbcd_SeqId_44_) 2023-07-12 13:16:06,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__rr882j4n6koh6l7k00lu70tflg35ofrsnrcblr7b8m373kt09lebuvgf4ql8t3ma/family1/573ac736c4d04740a52a235904ae2999 2023-07-12 13:16:06,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-12 13:16:06,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-12 13:16:06,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(1912): d615b79ac3c7ed8fb72118637ae048e6/family1 is initiating minor compaction 2023-07-12 13:16:06,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1c5f89c2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:16:06,723 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d615b79ac3c7ed8fb72118637ae048e6/family1 in testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:06,723 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/4457430f9e6443afa1f5239a60e305e5, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/5554624f5ac14e9aa5ee8fbb33e96f90, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/6978bf567bf64259ab3811cac45d5b80, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/872a5514485b4ed3baec739c78018894, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/6710aa74b2fe4540a21eb24bd1dffebe, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/b9a4c4fd838d4d1cb9fb4a42dd43e300, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/a75f984a44b042d9be519c79466269ea, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/2e20d4473476483e944c79d2181fbc64, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/95b98d034112468582ee118861b3d84c, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/ea8ed4a7d0294fd7a280a717e6a7dbcd_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp, totalSize=49.7 K 2023-07-12 13:16:06,723 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 4457430f9e6443afa1f5239a60e305e5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-12 13:16:06,723 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 5554624f5ac14e9aa5ee8fbb33e96f90, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-12 13:16:06,724 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 6978bf567bf64259ab3811cac45d5b80, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-12 13:16:06,724 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 872a5514485b4ed3baec739c78018894, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-12 13:16:06,724 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 6710aa74b2fe4540a21eb24bd1dffebe, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-12 13:16:06,724 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting b9a4c4fd838d4d1cb9fb4a42dd43e300, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-12 13:16:06,724 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting a75f984a44b042d9be519c79466269ea, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-12 13:16:06,724 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 2e20d4473476483e944c79d2181fbc64, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-12 13:16:06,724 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 95b98d034112468582ee118861b3d84c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-12 13:16:06,724 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting ea8ed4a7d0294fd7a280a717e6a7dbcd_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-12 13:16:06,725 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:16:06,726 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:06,728 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601011414a0c3840f4500bf6815a2248a8547 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601011414a0c3840f4500bf6815a2248a8547 2023-07-12 13:16:06,728 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b7f549ab173c4110b11c92a6f0eec784 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b7f549ab173c4110b11c92a6f0eec784 2023-07-12 13:16:06,729 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-07-12 13:16:06,729 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-07-12 13:16:06,729 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:16:06,729 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:16:06,762 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): d615b79ac3c7ed8fb72118637ae048e6#family1#compaction#166 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:16:07,590 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/fd568301796543e19f356d39d9f1e195 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/fd568301796543e19f356d39d9f1e195 2023-07-12 13:16:07,591 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316eb06a838b814bfeb7e6fe0f5c32e944 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512316eb06a838b814bfeb7e6fe0f5c32e944 2023-07-12 13:16:07,592 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:16:07,594 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in d615b79ac3c7ed8fb72118637ae048e6/family1 of d615b79ac3c7ed8fb72118637ae048e6 into fd568301796543e19f356d39d9f1e195(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:16:07,594 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:16:07,594 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1689167766723; duration=0sec 2023-07-12 13:16:07,594 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:16:07,611 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/a98cf79ff28b4ef6b3dc917df715ff14 first=Optional[r1] last=Optional[r4] 2023-07-12 13:16:07,612 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/a98cf79ff28b4ef6b3dc917df715ff14}] 2023-07-12 13:16:07,614 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/a98cf79ff28b4ef6b3dc917df715ff14 for inclusion in d615b79ac3c7ed8fb72118637ae048e6/family1 2023-07-12 13:16:07,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-07-12 13:16:07,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:16:07,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:16:07,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/a98cf79ff28b4ef6b3dc917df715ff14 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__uiemud78bq3ilous97sq7ffclq2vo4e2n0im6k74md65ej9k3ela5ob34t4cm27n/family1/a98cf79ff28b4ef6b3dc917df715ff14 2023-07-12 13:16:07,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__uiemud78bq3ilous97sq7ffclq2vo4e2n0im6k74md65ej9k3ela5ob34t4cm27n/family1/a98cf79ff28b4ef6b3dc917df715ff14 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/c51a1ec7156a491e9566f1cb9a38f427_SeqId_47_ 2023-07-12 13:16:07,619 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__uiemud78bq3ilous97sq7ffclq2vo4e2n0im6k74md65ej9k3ela5ob34t4cm27n/family1/a98cf79ff28b4ef6b3dc917df715ff14 into d615b79ac3c7ed8fb72118637ae048e6/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/c51a1ec7156a491e9566f1cb9a38f427_SeqId_47_ - updating store file list. 2023-07-12 13:16:07,621 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/c51a1ec7156a491e9566f1cb9a38f427_SeqId_47_ into d615b79ac3c7ed8fb72118637ae048e6/family1 2023-07-12 13:16:07,621 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__uiemud78bq3ilous97sq7ffclq2vo4e2n0im6k74md65ej9k3ela5ob34t4cm27n/family1/a98cf79ff28b4ef6b3dc917df715ff14 into d615b79ac3c7ed8fb72118637ae048e6/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/c51a1ec7156a491e9566f1cb9a38f427_SeqId_47_) 2023-07-12 13:16:07,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__uiemud78bq3ilous97sq7ffclq2vo4e2n0im6k74md65ej9k3ela5ob34t4cm27n/family1/a98cf79ff28b4ef6b3dc917df715ff14 2023-07-12 13:16:07,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 13:16:07,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 13:16:07,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(1912): d615b79ac3c7ed8fb72118637ae048e6/family1 is initiating minor compaction (all files) 2023-07-12 13:16:07,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1182ffc6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:16:07,622 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d615b79ac3c7ed8fb72118637ae048e6/family1 in testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:07,622 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/45a15ff5965d41da870b9f1b3d1f864d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/fd568301796543e19f356d39d9f1e195, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/c51a1ec7156a491e9566f1cb9a38f427_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp, totalSize=178.1 K 2023-07-12 13:16:07,623 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting 45a15ff5965d41da870b9f1b3d1f864d, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837060 2023-07-12 13:16:07,623 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting fd568301796543e19f356d39d9f1e195, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237060 2023-07-12 13:16:07,623 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] compactions.Compactor(207): Compacting c51a1ec7156a491e9566f1cb9a38f427_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965237060 2023-07-12 13:16:07,624 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:16:07,624 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:07,626 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201865afaee10f843b591fd25ce54cd3954 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201865afaee10f843b591fd25ce54cd3954 2023-07-12 13:16:07,627 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512057afa5c4e80d1483cb3ea432e3c9d85d3 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512057afa5c4e80d1483cb3ea432e3c9d85d3 2023-07-12 13:16:07,628 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512284b190afc06a44556b1340255c8327ba9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512284b190afc06a44556b1340255c8327ba9 2023-07-12 13:16:07,629 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231393f93ec41874976a3096b9baf28cfeb to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231393f93ec41874976a3096b9baf28cfeb 2023-07-12 13:16:07,629 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-07-12 13:16:07,629 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-07-12 13:16:07,630 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:16:07,630 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:16:07,637 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] throttle.PressureAwareThroughputController(145): d615b79ac3c7ed8fb72118637ae048e6#family1#compaction#167 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:16:07,668 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/4457430f9e6443afa1f5239a60e305e5, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/5554624f5ac14e9aa5ee8fbb33e96f90, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/6978bf567bf64259ab3811cac45d5b80, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/872a5514485b4ed3baec739c78018894, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/6710aa74b2fe4540a21eb24bd1dffebe, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/b9a4c4fd838d4d1cb9fb4a42dd43e300, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/a75f984a44b042d9be519c79466269ea, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/2e20d4473476483e944c79d2181fbc64, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/95b98d034112468582ee118861b3d84c, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/ea8ed4a7d0294fd7a280a717e6a7dbcd_SeqId_44_] to archive 2023-07-12 13:16:07,669 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:07,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/4457430f9e6443afa1f5239a60e305e5 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/4457430f9e6443afa1f5239a60e305e5 2023-07-12 13:16:07,671 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/5554624f5ac14e9aa5ee8fbb33e96f90 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/5554624f5ac14e9aa5ee8fbb33e96f90 2023-07-12 13:16:07,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/6978bf567bf64259ab3811cac45d5b80 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/6978bf567bf64259ab3811cac45d5b80 2023-07-12 13:16:07,673 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/872a5514485b4ed3baec739c78018894 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/872a5514485b4ed3baec739c78018894 2023-07-12 13:16:07,674 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/6710aa74b2fe4540a21eb24bd1dffebe to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/6710aa74b2fe4540a21eb24bd1dffebe 2023-07-12 13:16:07,675 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/b9a4c4fd838d4d1cb9fb4a42dd43e300 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/b9a4c4fd838d4d1cb9fb4a42dd43e300 2023-07-12 13:16:07,676 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/a75f984a44b042d9be519c79466269ea to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/a75f984a44b042d9be519c79466269ea 2023-07-12 13:16:07,677 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/2e20d4473476483e944c79d2181fbc64 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/2e20d4473476483e944c79d2181fbc64 2023-07-12 13:16:07,678 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/95b98d034112468582ee118861b3d84c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/95b98d034112468582ee118861b3d84c 2023-07-12 13:16:07,678 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/ea8ed4a7d0294fd7a280a717e6a7dbcd_SeqId_44_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/ea8ed4a7d0294fd7a280a717e6a7dbcd_SeqId_44_ 2023-07-12 13:16:08,466 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113033c34941430c48a597d82f8e53e092a4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113033c34941430c48a597d82f8e53e092a4 2023-07-12 13:16:08,467 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:16:08,491 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a9fd07d1a6014fe39537ecbf3b5f2d48 first=Optional[r00] last=Optional[r8] 2023-07-12 13:16:08,492 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a9fd07d1a6014fe39537ecbf3b5f2d48}] 2023-07-12 13:16:08,494 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a9fd07d1a6014fe39537ecbf3b5f2d48 for inclusion in d615b79ac3c7ed8fb72118637ae048e6/family1 2023-07-12 13:16:08,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-07-12 13:16:08,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last= 2023-07-12 13:16:08,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:16:08,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a9fd07d1a6014fe39537ecbf3b5f2d48 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__csp6e91qvm5h84lrg0hp1cqthebc7uu7euh3omtphrnhjnn8u7bi8t9rhdgvvgm/family1/a9fd07d1a6014fe39537ecbf3b5f2d48 2023-07-12 13:16:08,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__csp6e91qvm5h84lrg0hp1cqthebc7uu7euh3omtphrnhjnn8u7bi8t9rhdgvvgm/family1/a9fd07d1a6014fe39537ecbf3b5f2d48 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/b66c326928f14a4cb8b96f4ffe5407ea_SeqId_49_ 2023-07-12 13:16:08,500 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__csp6e91qvm5h84lrg0hp1cqthebc7uu7euh3omtphrnhjnn8u7bi8t9rhdgvvgm/family1/a9fd07d1a6014fe39537ecbf3b5f2d48 into d615b79ac3c7ed8fb72118637ae048e6/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/b66c326928f14a4cb8b96f4ffe5407ea_SeqId_49_ - updating store file list. 2023-07-12 13:16:08,504 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/b66c326928f14a4cb8b96f4ffe5407ea_SeqId_49_ into d615b79ac3c7ed8fb72118637ae048e6/family1 2023-07-12 13:16:08,504 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__csp6e91qvm5h84lrg0hp1cqthebc7uu7euh3omtphrnhjnn8u7bi8t9rhdgvvgm/family1/a9fd07d1a6014fe39537ecbf3b5f2d48 into d615b79ac3c7ed8fb72118637ae048e6/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/b66c326928f14a4cb8b96f4ffe5407ea_SeqId_49_) 2023-07-12 13:16:08,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMinorCompactionWithMonthlyPolicy__csp6e91qvm5h84lrg0hp1cqthebc7uu7euh3omtphrnhjnn8u7bi8t9rhdgvvgm/family1/a9fd07d1a6014fe39537ecbf3b5f2d48 2023-07-12 13:16:08,507 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:16:08,508 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:08,511 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511207a0d6abff4d14ecb897bda5da81a649b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511207a0d6abff4d14ecb897bda5da81a649b 2023-07-12 13:16:08,512 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128bb2d6026bdba4f93b5f6a0d5345aeb04 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128bb2d6026bdba4f93b5f6a0d5345aeb04 2023-07-12 13:16:08,513 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113063ef67d3f6c04f6bbba2bf88fc16002c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113063ef67d3f6c04f6bbba2bf88fc16002c 2023-07-12 13:16:08,514 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-07-12 13:16:08,514 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-12 13:16:08,514 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:16:08,514 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:16:08,514 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-12 13:16:08,514 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-12 13:16:08,514 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:16:08,517 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-12 13:16:08,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.7090 sec 2023-07-12 13:16:08,692 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=253 (was 256), OpenFileDescriptor=641 (was 649), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=159 (was 131) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=7729 (was 7817) 2023-07-12 13:16:08,704 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=253, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=159, ProcessCount=166, AvailableMemoryMB=7729 2023-07-12 13:16:08,722 DEBUG [Listener at localhost.localdomain/44505] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-07-12 13:16:08,763 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA5\xFD\x5C\xE1\x0E\xED\x06\x17\xA6+\xB9\xA2\xCC\xA6o)"\x107\x9D\xDD<\x96\x82qBr\xD4\xB9\x006\xA3\xE3l*\x10G\xA7\x90\x92\x1F\x82\xBA.\x87\xB3.\xD4\xDC5\xE1\xE62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 13:16:08,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-07-12 13:16:08,765 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:16:08,765 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-07-12 13:16:08,766 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:16:08,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-12 13:16:08,767 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c 2023-07-12 13:16:08,767 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043 2023-07-12 13:16:08,767 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09 2023-07-12 13:16:08,768 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c empty. 2023-07-12 13:16:08,768 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09 empty. 2023-07-12 13:16:08,768 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043 empty. 2023-07-12 13:16:08,768 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c 2023-07-12 13:16:08,768 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09 2023-07-12 13:16:08,768 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043 2023-07-12 13:16:08,768 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-07-12 13:16:08,864 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/.tmp/family1/486a18524f7748b0be7660e8a294b7bb as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/486a18524f7748b0be7660e8a294b7bb 2023-07-12 13:16:08,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-12 13:16:08,871 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d615b79ac3c7ed8fb72118637ae048e6/family1 of d615b79ac3c7ed8fb72118637ae048e6 into 486a18524f7748b0be7660e8a294b7bb(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:16:08,871 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:16:08,871 INFO [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1689167767622; duration=1sec 2023-07-12 13:16:08,871 DEBUG [RS:0;jenkins-hbase17:41721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 13:16:08,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/45a15ff5965d41da870b9f1b3d1f864d, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/fd568301796543e19f356d39d9f1e195, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/c51a1ec7156a491e9566f1cb9a38f427_SeqId_47_] to archive 2023-07-12 13:16:08,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:08,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/45a15ff5965d41da870b9f1b3d1f864d to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/45a15ff5965d41da870b9f1b3d1f864d 2023-07-12 13:16:08,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/fd568301796543e19f356d39d9f1e195 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/fd568301796543e19f356d39d9f1e195 2023-07-12 13:16:08,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/c51a1ec7156a491e9566f1cb9a38f427_SeqId_47_ to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/family1/c51a1ec7156a491e9566f1cb9a38f427_SeqId_47_ 2023-07-12 13:16:09,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-12 13:16:09,174 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-07-12 13:16:09,176 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => d2165571560ffa24987feffa1865ee2c, NAME => 'testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA5\xFD\x5C\xE1\x0E\xED\x06\x17\xA6+\xB9\xA2\xCC\xA6o)"\x107\x9D\xDD<\x96\x82qBr\xD4\xB9\x006\xA3\xE3l*\x10G\xA7\x90\x92\x1F\x82\xBA.\x87\xB3.\xD4\xDC5\xE1\xE62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:16:09,176 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => ae13b930868feb66fdcc03d9f473ae09, NAME => 'testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA5\xFD\x5C\xE1\x0E\xED\x06\x17\xA6+\xB9\xA2\xCC\xA6o)"\x107\x9D\xDD<\x96\x82qBr\xD4\xB9\x006\xA3\xE3l*\x10G\xA7\x90\x92\x1F\x82\xBA.\x87\xB3.\xD4\xDC5\xE1\xE62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:16:09,176 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => b9dd93b327e9720e302527e9c2cbf043, NAME => 'testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA5\xFD\x5C\xE1\x0E\xED\x06\x17\xA6+\xB9\xA2\xCC\xA6o)"\x107\x9D\xDD<\x96\x82qBr\xD4\xB9\x006\xA3\xE3l*\x10G\xA7\x90\x92\x1F\x82\xBA.\x87\xB3.\xD4\xDC5\xE1\xE62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/.tmp 2023-07-12 13:16:09,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-12 13:16:09,581 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:16:09,582 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:16:09,582 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:16:09,582 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing d2165571560ffa24987feffa1865ee2c, disabling compactions & flushes 2023-07-12 13:16:09,582 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:09,582 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:09,582 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing b9dd93b327e9720e302527e9c2cbf043, disabling compactions & flushes 2023-07-12 13:16:09,582 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:09,582 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:09,582 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. after waiting 0 ms 2023-07-12 13:16:09,582 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing ae13b930868feb66fdcc03d9f473ae09, disabling compactions & flushes 2023-07-12 13:16:09,583 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:09,583 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:09,583 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for b9dd93b327e9720e302527e9c2cbf043: 2023-07-12 13:16:09,582 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. after waiting 0 ms 2023-07-12 13:16:09,583 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:09,583 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:09,583 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. after waiting 0 ms 2023-07-12 13:16:09,583 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:09,583 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:09,583 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:09,583 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for d2165571560ffa24987feffa1865ee2c: 2023-07-12 13:16:09,583 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:09,584 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for ae13b930868feb66fdcc03d9f473ae09: 2023-07-12 13:16:09,587 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:16:09,588 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689167769588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167769588"}]},"ts":"1689167769588"} 2023-07-12 13:16:09,589 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689167769588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167769588"}]},"ts":"1689167769588"} 2023-07-12 13:16:09,589 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689167769588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689167769588"}]},"ts":"1689167769588"} 2023-07-12 13:16:09,592 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-12 13:16:09,593 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:16:09,593 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167769593"}]},"ts":"1689167769593"} 2023-07-12 13:16:09,595 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-07-12 13:16:09,600 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d2165571560ffa24987feffa1865ee2c, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b9dd93b327e9720e302527e9c2cbf043, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ae13b930868feb66fdcc03d9f473ae09, ASSIGN}] 2023-07-12 13:16:09,604 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ae13b930868feb66fdcc03d9f473ae09, ASSIGN 2023-07-12 13:16:09,604 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d2165571560ffa24987feffa1865ee2c, ASSIGN 2023-07-12 13:16:09,604 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b9dd93b327e9720e302527e9c2cbf043, ASSIGN 2023-07-12 13:16:09,605 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ae13b930868feb66fdcc03d9f473ae09, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:16:09,605 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d2165571560ffa24987feffa1865ee2c, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:16:09,605 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b9dd93b327e9720e302527e9c2cbf043, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41721,1689167613545; forceNewPlan=false, retain=false 2023-07-12 13:16:09,757 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=ae13b930868feb66fdcc03d9f473ae09, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:09,757 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=d2165571560ffa24987feffa1865ee2c, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:09,757 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689167769757"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167769757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167769757"}]},"ts":"1689167769757"} 2023-07-12 13:16:09,757 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689167769757"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167769757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167769757"}]},"ts":"1689167769757"} 2023-07-12 13:16:09,757 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=b9dd93b327e9720e302527e9c2cbf043, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:09,757 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689167769757"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689167769757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689167769757"}]},"ts":"1689167769757"} 2023-07-12 13:16:09,758 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure ae13b930868feb66fdcc03d9f473ae09, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:16:09,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure d2165571560ffa24987feffa1865ee2c, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:16:09,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure b9dd93b327e9720e302527e9c2cbf043, server=jenkins-hbase17.apache.org,41721,1689167613545}] 2023-07-12 13:16:09,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-12 13:16:09,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:09,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d2165571560ffa24987feffa1865ee2c, NAME => 'testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 13:16:09,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin d2165571560ffa24987feffa1865ee2c 2023-07-12 13:16:09,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:16:09,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for d2165571560ffa24987feffa1865ee2c 2023-07-12 13:16:09,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for d2165571560ffa24987feffa1865ee2c 2023-07-12 13:16:09,936 INFO [StoreOpener-d2165571560ffa24987feffa1865ee2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d2165571560ffa24987feffa1865ee2c 2023-07-12 13:16:09,938 DEBUG [StoreOpener-d2165571560ffa24987feffa1865ee2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1 2023-07-12 13:16:09,938 DEBUG [StoreOpener-d2165571560ffa24987feffa1865ee2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1 2023-07-12 13:16:09,938 INFO [StoreOpener-d2165571560ffa24987feffa1865ee2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2165571560ffa24987feffa1865ee2c columnFamilyName family1 2023-07-12 13:16:09,939 INFO [StoreOpener-d2165571560ffa24987feffa1865ee2c-1] regionserver.HStore(310): Store=d2165571560ffa24987feffa1865ee2c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:16:09,940 INFO [StoreOpener-d2165571560ffa24987feffa1865ee2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d2165571560ffa24987feffa1865ee2c 2023-07-12 13:16:09,941 DEBUG [StoreOpener-d2165571560ffa24987feffa1865ee2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2 2023-07-12 13:16:09,941 DEBUG [StoreOpener-d2165571560ffa24987feffa1865ee2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2 2023-07-12 13:16:09,941 INFO [StoreOpener-d2165571560ffa24987feffa1865ee2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2165571560ffa24987feffa1865ee2c columnFamilyName family2 2023-07-12 13:16:09,942 INFO [StoreOpener-d2165571560ffa24987feffa1865ee2c-1] regionserver.HStore(310): Store=d2165571560ffa24987feffa1865ee2c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:16:09,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c 2023-07-12 13:16:09,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c 2023-07-12 13:16:09,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:16:09,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for d2165571560ffa24987feffa1865ee2c 2023-07-12 13:16:09,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:16:09,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened d2165571560ffa24987feffa1865ee2c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70600226, jitterRate=0.05202534794807434}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:16:09,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for d2165571560ffa24987feffa1865ee2c: 2023-07-12 13:16:09,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c., pid=121, masterSystemTime=1689167769910 2023-07-12 13:16:09,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:09,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:09,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:09,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ae13b930868feb66fdcc03d9f473ae09, NAME => 'testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 13:16:09,948 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=d2165571560ffa24987feffa1865ee2c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:09,948 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689167769948"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167769948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167769948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167769948"}]},"ts":"1689167769948"} 2023-07-12 13:16:09,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin ae13b930868feb66fdcc03d9f473ae09 2023-07-12 13:16:09,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:16:09,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for ae13b930868feb66fdcc03d9f473ae09 2023-07-12 13:16:09,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for ae13b930868feb66fdcc03d9f473ae09 2023-07-12 13:16:09,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=117 2023-07-12 13:16:09,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure d2165571560ffa24987feffa1865ee2c, server=jenkins-hbase17.apache.org,41721,1689167613545 in 190 msec 2023-07-12 13:16:09,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d2165571560ffa24987feffa1865ee2c, ASSIGN in 351 msec 2023-07-12 13:16:09,968 INFO [StoreOpener-ae13b930868feb66fdcc03d9f473ae09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ae13b930868feb66fdcc03d9f473ae09 2023-07-12 13:16:09,969 DEBUG [StoreOpener-ae13b930868feb66fdcc03d9f473ae09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1 2023-07-12 13:16:09,969 DEBUG [StoreOpener-ae13b930868feb66fdcc03d9f473ae09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1 2023-07-12 13:16:09,969 INFO [StoreOpener-ae13b930868feb66fdcc03d9f473ae09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae13b930868feb66fdcc03d9f473ae09 columnFamilyName family1 2023-07-12 13:16:09,970 INFO [StoreOpener-ae13b930868feb66fdcc03d9f473ae09-1] regionserver.HStore(310): Store=ae13b930868feb66fdcc03d9f473ae09/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:16:09,970 INFO [StoreOpener-ae13b930868feb66fdcc03d9f473ae09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ae13b930868feb66fdcc03d9f473ae09 2023-07-12 13:16:09,971 DEBUG [StoreOpener-ae13b930868feb66fdcc03d9f473ae09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2 2023-07-12 13:16:09,971 DEBUG [StoreOpener-ae13b930868feb66fdcc03d9f473ae09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2 2023-07-12 13:16:09,972 INFO [StoreOpener-ae13b930868feb66fdcc03d9f473ae09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae13b930868feb66fdcc03d9f473ae09 columnFamilyName family2 2023-07-12 13:16:09,972 INFO [StoreOpener-ae13b930868feb66fdcc03d9f473ae09-1] regionserver.HStore(310): Store=ae13b930868feb66fdcc03d9f473ae09/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:16:09,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09 2023-07-12 13:16:09,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09 2023-07-12 13:16:09,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:16:09,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for ae13b930868feb66fdcc03d9f473ae09 2023-07-12 13:16:09,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:16:09,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened ae13b930868feb66fdcc03d9f473ae09; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58788014, jitterRate=-0.12399032711982727}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:16:09,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for ae13b930868feb66fdcc03d9f473ae09: 2023-07-12 13:16:09,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09., pid=120, masterSystemTime=1689167769910 2023-07-12 13:16:09,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:09,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:09,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:09,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b9dd93b327e9720e302527e9c2cbf043, NAME => 'testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043.', STARTKEY => '1', ENDKEY => '2'} 2023-07-12 13:16:09,978 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=ae13b930868feb66fdcc03d9f473ae09, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:09,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin b9dd93b327e9720e302527e9c2cbf043 2023-07-12 13:16:09,978 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689167769978"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167769978"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167769978"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167769978"}]},"ts":"1689167769978"} 2023-07-12 13:16:09,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:16:09,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for b9dd93b327e9720e302527e9c2cbf043 2023-07-12 13:16:09,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for b9dd93b327e9720e302527e9c2cbf043 2023-07-12 13:16:09,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=119 2023-07-12 13:16:09,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure ae13b930868feb66fdcc03d9f473ae09, server=jenkins-hbase17.apache.org,41721,1689167613545 in 221 msec 2023-07-12 13:16:09,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ae13b930868feb66fdcc03d9f473ae09, ASSIGN in 380 msec 2023-07-12 13:16:09,995 INFO [StoreOpener-b9dd93b327e9720e302527e9c2cbf043-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b9dd93b327e9720e302527e9c2cbf043 2023-07-12 13:16:09,997 DEBUG [StoreOpener-b9dd93b327e9720e302527e9c2cbf043-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1 2023-07-12 13:16:09,997 DEBUG [StoreOpener-b9dd93b327e9720e302527e9c2cbf043-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1 2023-07-12 13:16:09,997 INFO [StoreOpener-b9dd93b327e9720e302527e9c2cbf043-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9dd93b327e9720e302527e9c2cbf043 columnFamilyName family1 2023-07-12 13:16:09,998 INFO [StoreOpener-b9dd93b327e9720e302527e9c2cbf043-1] regionserver.HStore(310): Store=b9dd93b327e9720e302527e9c2cbf043/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:16:09,998 INFO [StoreOpener-b9dd93b327e9720e302527e9c2cbf043-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b9dd93b327e9720e302527e9c2cbf043 2023-07-12 13:16:09,999 DEBUG [StoreOpener-b9dd93b327e9720e302527e9c2cbf043-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2 2023-07-12 13:16:09,999 DEBUG [StoreOpener-b9dd93b327e9720e302527e9c2cbf043-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2 2023-07-12 13:16:10,000 INFO [StoreOpener-b9dd93b327e9720e302527e9c2cbf043-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9dd93b327e9720e302527e9c2cbf043 columnFamilyName family2 2023-07-12 13:16:10,000 INFO [StoreOpener-b9dd93b327e9720e302527e9c2cbf043-1] regionserver.HStore(310): Store=b9dd93b327e9720e302527e9c2cbf043/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:16:10,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043 2023-07-12 13:16:10,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043 2023-07-12 13:16:10,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 13:16:10,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for b9dd93b327e9720e302527e9c2cbf043 2023-07-12 13:16:10,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:16:10,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened b9dd93b327e9720e302527e9c2cbf043; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71523956, jitterRate=0.06578999757766724}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 13:16:10,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for b9dd93b327e9720e302527e9c2cbf043: 2023-07-12 13:16:10,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043., pid=122, masterSystemTime=1689167769910 2023-07-12 13:16:10,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:10,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:10,008 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=b9dd93b327e9720e302527e9c2cbf043, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:10,009 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689167770008"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689167770008"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689167770008"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689167770008"}]},"ts":"1689167770008"} 2023-07-12 13:16:10,011 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=118 2023-07-12 13:16:10,011 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure b9dd93b327e9720e302527e9c2cbf043, server=jenkins-hbase17.apache.org,41721,1689167613545 in 251 msec 2023-07-12 13:16:10,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-12 13:16:10,013 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b9dd93b327e9720e302527e9c2cbf043, ASSIGN in 411 msec 2023-07-12 13:16:10,013 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:16:10,013 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689167770013"}]},"ts":"1689167770013"} 2023-07-12 13:16:10,014 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-07-12 13:16:10,016 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:16:10,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2530 sec 2023-07-12 13:16:10,796 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-07-12 13:16:10,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-12 13:16:10,872 INFO [Listener at localhost.localdomain/44505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-07-12 13:16:10,886 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:16:10,887 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:16:10,887 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:16:10,889 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:16:10,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-12 13:16:10,893 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-12 13:16:10,893 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:10,893 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-12 13:16:10,893 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-12 13:16:10,893 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:10,893 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:10,894 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:10,894 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:10,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:10,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:10,894 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:10,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:10,894 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:16:10,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:10,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:16:10,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:10,895 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-12 13:16:10,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-12 13:16:10,895 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-12 13:16:10,895 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:10,895 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-12 13:16:10,896 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:10,896 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. started... 2023-07-12 13:16:10,901 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae13b930868feb66fdcc03d9f473ae09 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-12 13:16:10,901 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:10,901 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:16:10,901 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:16:10,901 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. started... 2023-07-12 13:16:10,901 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:10,901 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. started... 2023-07-12 13:16:10,901 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b9dd93b327e9720e302527e9c2cbf043 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-12 13:16:10,902 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2165571560ffa24987feffa1865ee2c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-12 13:16:10,944 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071246dea9f2edb146c9bb33423ed7bc0b24 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023071246dea9f2edb146c9bb33423ed7bc0b24 2023-07-12 13:16:11,345 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307120f36cb55b4444fb38315c76fbbfb368b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202307120f36cb55b4444fb38315c76fbbfb368b 2023-07-12 13:16:11,345 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712348313a350bd42abb15c4c39de103332 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230712348313a350bd42abb15c4c39de103332 2023-07-12 13:16:11,356 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family1/0b437aa291e44698a3c9609a2b9a2b12 2023-07-12 13:16:11,357 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family1/1fd03b9c66a846188ff1764675f6a29f 2023-07-12 13:16:11,357 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family1/2675a20429b04f6897f175a42e01f3ff 2023-07-12 13:16:11,790 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071278c9f8378de5458d814da89b8a90249a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023071278c9f8378de5458d814da89b8a90249a 2023-07-12 13:16:11,795 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family2/980bc5eec19940068c31623cfc1abd1b 2023-07-12 13:16:11,799 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712063cd3104bae43df96debb8be98d4075 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230712063cd3104bae43df96debb8be98d4075 2023-07-12 13:16:11,799 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307129f3bbdd28fef4057a3286e4ab4009d31 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202307129f3bbdd28fef4057a3286e4ab4009d31 2023-07-12 13:16:11,802 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family1/0b437aa291e44698a3c9609a2b9a2b12 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/0b437aa291e44698a3c9609a2b9a2b12 2023-07-12 13:16:11,823 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/0b437aa291e44698a3c9609a2b9a2b12, entries=4, sequenceid=5, filesize=5.5 K 2023-07-12 13:16:11,824 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family2/980bc5eec19940068c31623cfc1abd1b as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/980bc5eec19940068c31623cfc1abd1b 2023-07-12 13:16:11,827 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/980bc5eec19940068c31623cfc1abd1b, entries=2, sequenceid=5, filesize=5.1 K 2023-07-12 13:16:11,827 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d2165571560ffa24987feffa1865ee2c in 925ms, sequenceid=5, compaction requested=false 2023-07-12 13:16:11,828 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2165571560ffa24987feffa1865ee2c: 2023-07-12 13:16:11,828 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:11,828 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:16:12,205 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family2/a222f642d8324f4db28036d8fe24a398 2023-07-12 13:16:12,205 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family2/2d48c46fa6f14febba2ba2315266471a 2023-07-12 13:16:12,213 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family1/2675a20429b04f6897f175a42e01f3ff as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/2675a20429b04f6897f175a42e01f3ff 2023-07-12 13:16:12,213 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family1/1fd03b9c66a846188ff1764675f6a29f as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/1fd03b9c66a846188ff1764675f6a29f 2023-07-12 13:16:12,237 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/1fd03b9c66a846188ff1764675f6a29f, entries=4, sequenceid=5, filesize=5.5 K 2023-07-12 13:16:12,237 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/2675a20429b04f6897f175a42e01f3ff, entries=4, sequenceid=5, filesize=5.5 K 2023-07-12 13:16:12,238 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family2/a222f642d8324f4db28036d8fe24a398 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/a222f642d8324f4db28036d8fe24a398 2023-07-12 13:16:12,238 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family2/2d48c46fa6f14febba2ba2315266471a as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/2d48c46fa6f14febba2ba2315266471a 2023-07-12 13:16:12,242 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/2d48c46fa6f14febba2ba2315266471a, entries=2, sequenceid=5, filesize=5.1 K 2023-07-12 13:16:12,242 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/a222f642d8324f4db28036d8fe24a398, entries=2, sequenceid=5, filesize=5.1 K 2023-07-12 13:16:12,243 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ae13b930868feb66fdcc03d9f473ae09 in 1342ms, sequenceid=5, compaction requested=false 2023-07-12 13:16:12,243 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b9dd93b327e9720e302527e9c2cbf043 in 1342ms, sequenceid=5, compaction requested=false 2023-07-12 13:16:12,243 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae13b930868feb66fdcc03d9f473ae09: 2023-07-12 13:16:12,243 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b9dd93b327e9720e302527e9c2cbf043: 2023-07-12 13:16:12,243 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:12,243 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:12,243 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:16:12,243 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:16:12,243 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:16:12,243 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,243 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-12 13:16:12,243 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-12 13:16:12,244 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,244 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:12,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:12,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:12,244 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:12,244 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:16:12,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:12,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:12,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:12,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:12,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-12 13:16:12,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11fc7e7d[Count = 0] remaining members to acquire global barrier 2023-07-12 13:16:12,246 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-12 13:16:12,246 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:12,246 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:12,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:12,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:12,246 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-12 13:16:12,246 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-12 13:16:12,246 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,246 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:16:12,246 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:16:12,247 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-12 13:16:12,247 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,247 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:12,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:12,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:12,247 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-12 13:16:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:12,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:12,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:16:12,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-12 13:16:12,249 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-12 13:16:12,249 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:16:12,249 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:16:12,249 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-12 13:16:12,249 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:16:12,250 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:12,250 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:12,250 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:12,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:12,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:12,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:12,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:12,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:12,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:12,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:12,251 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:12,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:12,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:12,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:12,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:12,252 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:12,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:12,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,253 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,253 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:12,253 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:12,253 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:12,253 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:12,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:12,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:12,254 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-12 13:16:12,254 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:16:12,254 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,254 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:12,254 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:12,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:12,254 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:12,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-07-12 13:16:12,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:12,254 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:12,254 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-12 13:16:12,254 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:16:12,354 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:16:12,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:16:12,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:16:12,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:16:12,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:16:12,359 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:16:12,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-07-12 13:16:12,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-12 13:16:12,361 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-12 13:16:12,361 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:12,361 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-12 13:16:12,361 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-12 13:16:12,361 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:12,362 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:12,362 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:12,362 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:12,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:12,363 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:12,363 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:16:12,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:12,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:12,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:16:12,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:12,363 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-12 13:16:12,363 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-07-12 13:16:12,363 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-12 13:16:12,364 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-12 13:16:12,364 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:12,364 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-12 13:16:12,364 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:12,364 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. started... 2023-07-12 13:16:12,364 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:12,364 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:16:12,364 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae13b930868feb66fdcc03d9f473ae09 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-12 13:16:12,364 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. started... 2023-07-12 13:16:12,364 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:12,364 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:16:12,364 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b9dd93b327e9720e302527e9c2cbf043 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-12 13:16:12,364 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. started... 2023-07-12 13:16:12,364 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2165571560ffa24987feffa1865ee2c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-12 13:16:12,807 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712869cdd7e8a8648eba4da5d549bc310e2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230712869cdd7e8a8648eba4da5d549bc310e2 2023-07-12 13:16:12,809 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712d68ff129d4c84649821d0d792ef24d1c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230712d68ff129d4c84649821d0d792ef24d1c 2023-07-12 13:16:12,816 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307129ba637e4f9d4423daebdb41d4e0714e2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307129ba637e4f9d4423daebdb41d4e0714e2 2023-07-12 13:16:12,825 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family1/76e8844f1e3c4602834270b70f365929 2023-07-12 13:16:12,831 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family1/2de31fad15a24e159422e4c95e083c1a 2023-07-12 13:16:12,834 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family1/518358f5498f43d3baa6a4e547feeacf 2023-07-12 13:16:13,271 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712f367a1619dae454d864f24318a2d8820 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230712f367a1619dae454d864f24318a2d8820 2023-07-12 13:16:13,278 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family2/9b75b84e8c3946728ef6dbdd0168b1c4 2023-07-12 13:16:13,279 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712c906694c79bc40f1b8289200c43997f5 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230712c906694c79bc40f1b8289200c43997f5 2023-07-12 13:16:13,285 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712518c6e478bcd4b4fb14fc6376f238000 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230712518c6e478bcd4b4fb14fc6376f238000 2023-07-12 13:16:13,288 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family1/2de31fad15a24e159422e4c95e083c1a as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/2de31fad15a24e159422e4c95e083c1a 2023-07-12 13:16:13,307 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/2de31fad15a24e159422e4c95e083c1a, entries=4, sequenceid=9, filesize=5.5 K 2023-07-12 13:16:13,308 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family2/9b75b84e8c3946728ef6dbdd0168b1c4 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/9b75b84e8c3946728ef6dbdd0168b1c4 2023-07-12 13:16:13,311 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/9b75b84e8c3946728ef6dbdd0168b1c4, entries=2, sequenceid=9, filesize=5.1 K 2023-07-12 13:16:13,312 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d2165571560ffa24987feffa1865ee2c in 948ms, sequenceid=9, compaction requested=false 2023-07-12 13:16:13,312 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2165571560ffa24987feffa1865ee2c: 2023-07-12 13:16:13,312 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:13,312 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:16:13,691 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family2/335623c4006c47cdbf14c5a18ae3ce64 2023-07-12 13:16:13,691 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family2/f16d4320ae574a6f8b063ed48d23ea23 2023-07-12 13:16:13,702 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family1/76e8844f1e3c4602834270b70f365929 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/76e8844f1e3c4602834270b70f365929 2023-07-12 13:16:13,702 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family1/518358f5498f43d3baa6a4e547feeacf as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/518358f5498f43d3baa6a4e547feeacf 2023-07-12 13:16:13,724 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/518358f5498f43d3baa6a4e547feeacf, entries=4, sequenceid=9, filesize=5.5 K 2023-07-12 13:16:13,724 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/76e8844f1e3c4602834270b70f365929, entries=4, sequenceid=9, filesize=5.5 K 2023-07-12 13:16:13,725 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family2/335623c4006c47cdbf14c5a18ae3ce64 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/335623c4006c47cdbf14c5a18ae3ce64 2023-07-12 13:16:13,725 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family2/f16d4320ae574a6f8b063ed48d23ea23 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/f16d4320ae574a6f8b063ed48d23ea23 2023-07-12 13:16:13,728 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/f16d4320ae574a6f8b063ed48d23ea23, entries=2, sequenceid=9, filesize=5.1 K 2023-07-12 13:16:13,728 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/335623c4006c47cdbf14c5a18ae3ce64, entries=2, sequenceid=9, filesize=5.1 K 2023-07-12 13:16:13,729 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b9dd93b327e9720e302527e9c2cbf043 in 1365ms, sequenceid=9, compaction requested=false 2023-07-12 13:16:13,729 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ae13b930868feb66fdcc03d9f473ae09 in 1365ms, sequenceid=9, compaction requested=false 2023-07-12 13:16:13,729 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b9dd93b327e9720e302527e9c2cbf043: 2023-07-12 13:16:13,729 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae13b930868feb66fdcc03d9f473ae09: 2023-07-12 13:16:13,729 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:13,729 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:13,729 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:16:13,729 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:16:13,729 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:16:13,729 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,729 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-12 13:16:13,729 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-12 13:16:13,730 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:13,730 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:13,730 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:13,730 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:16:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:13,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:13,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:13,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:13,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-12 13:16:13,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f58aaf1[Count = 0] remaining members to acquire global barrier 2023-07-12 13:16:13,731 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-12 13:16:13,732 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:13,732 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:13,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:13,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:13,732 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-12 13:16:13,732 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-12 13:16:13,732 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:16:13,732 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,732 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:16:13,733 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-12 13:16:13,733 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,733 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:13,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:13,733 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-12 13:16:13,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:13,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:13,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:13,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:13,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:13,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:13,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:16:13,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-12 13:16:13,735 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-12 13:16:13,735 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:16:13,735 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:16:13,735 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-12 13:16:13,735 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:16:13,735 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:13,735 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:13,735 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:13,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:13,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:13,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:13,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:13,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:13,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:13,736 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:13,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:13,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:13,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:13,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:13,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:13,737 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:13,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:13,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,738 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,738 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:13,738 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:13,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:13,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:13,738 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:13,738 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-12 13:16:13,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:16:13,738 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:13,738 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:13,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-07-12 13:16:13,739 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,739 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-12 13:16:13,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:13,739 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:16:13,739 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:13,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:13,739 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:13,739 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:13,839 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:16:13,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:16:13,841 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:16:13,841 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:16:13,841 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:16:13,843 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:16:13,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-07-12 13:16:13,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-12 13:16:13,845 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-12 13:16:13,845 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:13,845 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-12 13:16:13,845 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-12 13:16:13,846 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:13,846 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:13,847 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,847 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:13,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:13,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:13,847 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:13,847 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:16:13,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:13,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:13,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:16:13,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:13,847 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-12 13:16:13,848 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-07-12 13:16:13,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-12 13:16:13,848 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-12 13:16:13,848 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:13,848 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-12 13:16:13,848 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:13,848 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. started... 2023-07-12 13:16:13,848 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:16:13,848 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:16:13,848 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:13,848 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. started... 2023-07-12 13:16:13,848 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:13,848 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2165571560ffa24987feffa1865ee2c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-12 13:16:13,848 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. started... 2023-07-12 13:16:13,848 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae13b930868feb66fdcc03d9f473ae09 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-12 13:16:13,848 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b9dd93b327e9720e302527e9c2cbf043 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-12 13:16:14,302 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712a3589694f7c34b3da9786e4c093246d9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230712a3589694f7c34b3da9786e4c093246d9 2023-07-12 13:16:14,302 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712b4ab6fa0b1f548f2a18d188355b17c9e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230712b4ab6fa0b1f548f2a18d188355b17c9e 2023-07-12 13:16:14,302 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712cb2a17025bca4e72a72b0cfb5a9a0994 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230712cb2a17025bca4e72a72b0cfb5a9a0994 2023-07-12 13:16:14,325 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family1/3b7533619e5743efae44282bad5cc182 2023-07-12 13:16:14,326 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family1/b8fdbf34330e47c3bc404730dd8e57e7 2023-07-12 13:16:14,727 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family1/06ea3c37a7b0485d91c43c54fa985a64 2023-07-12 13:16:14,766 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712d614e8fd7291454ba859cbee6c1b45b6 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230712d614e8fd7291454ba859cbee6c1b45b6 2023-07-12 13:16:14,772 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307129ab47f35234346aca54591be1ca1f393 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202307129ab47f35234346aca54591be1ca1f393 2023-07-12 13:16:14,777 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family2/9aaca5753c0f4b7d85ab38d28de4c8f8 2023-07-12 13:16:14,782 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family1/b8fdbf34330e47c3bc404730dd8e57e7 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/b8fdbf34330e47c3bc404730dd8e57e7 2023-07-12 13:16:14,806 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/b8fdbf34330e47c3bc404730dd8e57e7, entries=4, sequenceid=13, filesize=5.5 K 2023-07-12 13:16:14,806 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family2/9aaca5753c0f4b7d85ab38d28de4c8f8 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/9aaca5753c0f4b7d85ab38d28de4c8f8 2023-07-12 13:16:14,810 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/9aaca5753c0f4b7d85ab38d28de4c8f8, entries=2, sequenceid=13, filesize=5.1 K 2023-07-12 13:16:14,810 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d2165571560ffa24987feffa1865ee2c in 962ms, sequenceid=13, compaction requested=true 2023-07-12 13:16:14,810 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2165571560ffa24987feffa1865ee2c: 2023-07-12 13:16:14,810 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:14,810 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:16:15,171 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family2/137b74c66cbe4726aaa15c152e6bada3 2023-07-12 13:16:15,171 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307123374b37277c84e7c9b03b61943234f53 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202307123374b37277c84e7c9b03b61943234f53 2023-07-12 13:16:15,180 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family1/3b7533619e5743efae44282bad5cc182 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/3b7533619e5743efae44282bad5cc182 2023-07-12 13:16:15,181 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family2/dbb125bf1e7042ca9765b424783c4f87 2023-07-12 13:16:15,186 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family1/06ea3c37a7b0485d91c43c54fa985a64 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/06ea3c37a7b0485d91c43c54fa985a64 2023-07-12 13:16:15,205 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/3b7533619e5743efae44282bad5cc182, entries=4, sequenceid=13, filesize=5.5 K 2023-07-12 13:16:15,205 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family2/137b74c66cbe4726aaa15c152e6bada3 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/137b74c66cbe4726aaa15c152e6bada3 2023-07-12 13:16:15,207 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/06ea3c37a7b0485d91c43c54fa985a64, entries=4, sequenceid=13, filesize=5.5 K 2023-07-12 13:16:15,208 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family2/dbb125bf1e7042ca9765b424783c4f87 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/dbb125bf1e7042ca9765b424783c4f87 2023-07-12 13:16:15,209 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/137b74c66cbe4726aaa15c152e6bada3, entries=2, sequenceid=13, filesize=5.1 K 2023-07-12 13:16:15,210 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b9dd93b327e9720e302527e9c2cbf043 in 1362ms, sequenceid=13, compaction requested=true 2023-07-12 13:16:15,210 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b9dd93b327e9720e302527e9c2cbf043: 2023-07-12 13:16:15,210 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:15,210 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:16:15,211 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/dbb125bf1e7042ca9765b424783c4f87, entries=2, sequenceid=13, filesize=5.1 K 2023-07-12 13:16:15,212 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ae13b930868feb66fdcc03d9f473ae09 in 1364ms, sequenceid=13, compaction requested=true 2023-07-12 13:16:15,212 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae13b930868feb66fdcc03d9f473ae09: 2023-07-12 13:16:15,212 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:15,212 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:16:15,212 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:16:15,212 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,212 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-12 13:16:15,212 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-12 13:16:15,213 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,213 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:15,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:15,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:15,213 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:15,213 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:16:15,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:15,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:15,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:15,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:15,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-12 13:16:15,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70a08a96[Count = 0] remaining members to acquire global barrier 2023-07-12 13:16:15,214 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-12 13:16:15,214 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:15,215 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:15,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:15,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:15,215 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,215 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:16:15,215 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-12 13:16:15,215 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-12 13:16:15,215 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:16:15,216 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-12 13:16:15,216 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,216 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:15,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:15,216 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-12 13:16:15,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:15,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:16:15,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-12 13:16:15,218 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-12 13:16:15,218 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:16:15,218 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:16:15,218 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-12 13:16:15,218 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:16:15,219 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:15,219 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:15,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:15,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:15,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:15,219 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:15,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:15,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:15,220 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:15,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:15,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:15,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:15,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:15,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:15,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:15,220 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:15,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:15,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,223 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:15,223 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:15,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:15,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:15,223 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,223 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-12 13:16:15,223 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:16:15,223 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:15,223 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:15,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:15,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:15,223 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:15,223 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,223 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:15,223 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:15,223 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-12 13:16:15,223 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:15,223 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:16:15,323 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:16:15,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:16:15,325 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:16:15,325 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:16:15,325 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 13:16:15,328 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:16:15,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-07-12 13:16:15,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-12 13:16:15,329 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-12 13:16:15,329 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:15,329 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-12 13:16:15,329 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-12 13:16:15,330 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:15,330 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:15,330 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:15,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:15,330 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:15,331 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:15,331 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:16:15,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:15,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:15,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:16:15,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:15,331 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-12 13:16:15,332 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-07-12 13:16:15,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-12 13:16:15,332 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-12 13:16:15,332 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:15,332 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-12 13:16:15,332 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:15,332 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:16:15,332 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:15,332 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. started... 2023-07-12 13:16:15,332 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:15,332 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. started... 2023-07-12 13:16:15,333 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b9dd93b327e9720e302527e9c2cbf043 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-12 13:16:15,332 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:16:15,333 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2165571560ffa24987feffa1865ee2c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-12 13:16:15,333 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. started... 2023-07-12 13:16:15,333 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae13b930868feb66fdcc03d9f473ae09 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-12 13:16:15,453 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 13:16:15,772 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712e50c4b3c3d614bc482ea2f76cc5f19fb to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230712e50c4b3c3d614bc482ea2f76cc5f19fb 2023-07-12 13:16:15,772 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712d05a58402fbe401f975a49de0d5ec448 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230712d05a58402fbe401f975a49de0d5ec448 2023-07-12 13:16:15,772 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071242140dd731c342818f9a5ce9afcc0d61 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023071242140dd731c342818f9a5ce9afcc0d61 2023-07-12 13:16:16,186 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family1/c1f5e1ae62314142b353090022f6a14a 2023-07-12 13:16:16,186 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family1/8378b6bead834679a851a7846968a43f 2023-07-12 13:16:16,186 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family1/dc30a91c191f4483b65cb319cb340476 2023-07-12 13:16:16,623 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071252d42976622e4923978489508c67f21b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023071252d42976622e4923978489508c67f21b 2023-07-12 13:16:16,629 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family2/50330285ae4548aa90cac8e374d1ac80 2023-07-12 13:16:16,629 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712ac827937dcb04ee8b81793e5fa5d8aa4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230712ac827937dcb04ee8b81793e5fa5d8aa4 2023-07-12 13:16:16,632 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071258835709357a4fc98f949e93a109aa1b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023071258835709357a4fc98f949e93a109aa1b 2023-07-12 13:16:16,632 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family1/8378b6bead834679a851a7846968a43f as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/8378b6bead834679a851a7846968a43f 2023-07-12 13:16:16,660 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/8378b6bead834679a851a7846968a43f, entries=4, sequenceid=17, filesize=5.5 K 2023-07-12 13:16:16,661 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family2/50330285ae4548aa90cac8e374d1ac80 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/50330285ae4548aa90cac8e374d1ac80 2023-07-12 13:16:16,664 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/50330285ae4548aa90cac8e374d1ac80, entries=2, sequenceid=17, filesize=5.1 K 2023-07-12 13:16:16,665 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d2165571560ffa24987feffa1865ee2c in 1332ms, sequenceid=17, compaction requested=true 2023-07-12 13:16:16,665 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2165571560ffa24987feffa1865ee2c: 2023-07-12 13:16:16,665 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:16,665 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:16:17,043 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family2/a6bf1a9ff97c468ba12dddcaf7e25c6f 2023-07-12 13:16:17,043 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family2/43e12cbe637b47ba9cacd4db5cc6f812 2023-07-12 13:16:17,049 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family1/dc30a91c191f4483b65cb319cb340476 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/dc30a91c191f4483b65cb319cb340476 2023-07-12 13:16:17,050 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family1/c1f5e1ae62314142b353090022f6a14a as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/c1f5e1ae62314142b353090022f6a14a 2023-07-12 13:16:17,073 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/c1f5e1ae62314142b353090022f6a14a, entries=4, sequenceid=17, filesize=5.5 K 2023-07-12 13:16:17,074 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family2/43e12cbe637b47ba9cacd4db5cc6f812 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/43e12cbe637b47ba9cacd4db5cc6f812 2023-07-12 13:16:17,078 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/43e12cbe637b47ba9cacd4db5cc6f812, entries=2, sequenceid=17, filesize=5.1 K 2023-07-12 13:16:17,079 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ae13b930868feb66fdcc03d9f473ae09 in 1746ms, sequenceid=17, compaction requested=true 2023-07-12 13:16:17,079 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae13b930868feb66fdcc03d9f473ae09: 2023-07-12 13:16:17,079 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:17,079 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:16:17,081 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/dc30a91c191f4483b65cb319cb340476, entries=4, sequenceid=17, filesize=5.5 K 2023-07-12 13:16:17,081 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family2/a6bf1a9ff97c468ba12dddcaf7e25c6f as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/a6bf1a9ff97c468ba12dddcaf7e25c6f 2023-07-12 13:16:17,085 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/a6bf1a9ff97c468ba12dddcaf7e25c6f, entries=2, sequenceid=17, filesize=5.1 K 2023-07-12 13:16:17,086 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b9dd93b327e9720e302527e9c2cbf043 in 1753ms, sequenceid=17, compaction requested=true 2023-07-12 13:16:17,086 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b9dd93b327e9720e302527e9c2cbf043: 2023-07-12 13:16:17,086 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:17,086 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:16:17,086 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:16:17,086 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,086 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-12 13:16:17,086 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-12 13:16:17,087 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:17,087 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:17,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:17,087 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:17,087 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:16:17,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:17,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:17,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:17,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:17,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-12 13:16:17,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@117be9ac[Count = 0] remaining members to acquire global barrier 2023-07-12 13:16:17,089 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-12 13:16:17,089 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:17,089 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:17,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:17,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:17,089 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-12 13:16:17,089 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-12 13:16:17,089 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:16:17,090 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,090 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:16:17,090 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-12 13:16:17,090 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:17,090 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,090 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-12 13:16:17,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:17,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:17,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:17,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:17,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:17,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:17,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:17,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:16:17,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-12 13:16:17,093 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-12 13:16:17,093 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:16:17,093 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:16:17,093 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-12 13:16:17,093 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:16:17,095 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:17,095 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:17,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:17,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:17,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:17,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:17,095 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:17,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:17,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:17,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:17,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:17,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:17,096 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:17,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:17,097 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:17,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:17,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:17,100 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,100 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:17,100 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:17,100 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,100 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:17,100 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:17,100 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:17,100 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-12 13:16:17,100 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:16:17,100 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:17,101 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:17,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:17,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:17,100 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:17,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-07-12 13:16:17,101 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-12 13:16:17,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:17,101 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:16:17,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:17,201 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:16:17,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:16:17,219 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:16:17,225 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:16:17,232 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:16:17,232 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:16:17,325 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:16:17,325 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b0809e2 to 127.0.0.1:51470 2023-07-12 13:16:17,325 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:16:17,336 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-12 13:16:17,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-07-12 13:16:17,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-12 13:16:17,337 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-12 13:16:17,337 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:17,337 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-12 13:16:17,337 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-12 13:16:17,337 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:17,337 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:17,338 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:17,338 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:17,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:17,338 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:17,339 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 13:16:17,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:17,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:17,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 13:16:17,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:17,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-12 13:16:17,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-12 13:16:17,339 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-12 13:16:17,339 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 13:16:17,340 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-12 13:16:17,340 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:17,340 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-12 13:16:17,340 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 13:16:17,340 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:17,340 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:17,340 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. started... 2023-07-12 13:16:17,340 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. started... 2023-07-12 13:16:17,340 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. started... 2023-07-12 13:16:17,340 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae13b930868feb66fdcc03d9f473ae09 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-12 13:16:17,340 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b9dd93b327e9720e302527e9c2cbf043 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-12 13:16:17,340 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2165571560ffa24987feffa1865ee2c 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-12 13:16:17,774 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family1/6bdf38cbc4034179a63c83a0e8deeb51 2023-07-12 13:16:17,785 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family1/45f5470d5ac84cf19821237cb0d22c36 2023-07-12 13:16:17,786 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family1/38c1a16fe7f3427d853e5a14862596fb 2023-07-12 13:16:17,799 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6bdf38cbc4034179a63c83a0e8deeb51 2023-07-12 13:16:17,805 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45f5470d5ac84cf19821237cb0d22c36 2023-07-12 13:16:17,813 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38c1a16fe7f3427d853e5a14862596fb 2023-07-12 13:16:18,228 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family2/fcc234c866d44d2da73cd0f58346361e 2023-07-12 13:16:18,230 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fcc234c866d44d2da73cd0f58346361e 2023-07-12 13:16:18,231 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family1/38c1a16fe7f3427d853e5a14862596fb as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/38c1a16fe7f3427d853e5a14862596fb 2023-07-12 13:16:18,256 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38c1a16fe7f3427d853e5a14862596fb 2023-07-12 13:16:18,256 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/38c1a16fe7f3427d853e5a14862596fb, entries=3, sequenceid=23, filesize=5.2 K 2023-07-12 13:16:18,257 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family2/fcc234c866d44d2da73cd0f58346361e as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/fcc234c866d44d2da73cd0f58346361e 2023-07-12 13:16:18,261 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fcc234c866d44d2da73cd0f58346361e 2023-07-12 13:16:18,261 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/fcc234c866d44d2da73cd0f58346361e, entries=1, sequenceid=23, filesize=5.0 K 2023-07-12 13:16:18,262 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ae13b930868feb66fdcc03d9f473ae09 in 922ms, sequenceid=23, compaction requested=true 2023-07-12 13:16:18,262 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae13b930868feb66fdcc03d9f473ae09: 2023-07-12 13:16:18,262 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:18,262 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-12 13:16:18,626 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family2/1887394253794d568550b32e0d8d3b10 2023-07-12 13:16:18,629 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family2/8f5dc6a10d914dbc82d639bc4fac4969 2023-07-12 13:16:18,636 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1887394253794d568550b32e0d8d3b10 2023-07-12 13:16:18,638 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family1/6bdf38cbc4034179a63c83a0e8deeb51 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/6bdf38cbc4034179a63c83a0e8deeb51 2023-07-12 13:16:18,638 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f5dc6a10d914dbc82d639bc4fac4969 2023-07-12 13:16:18,639 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family1/45f5470d5ac84cf19821237cb0d22c36 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/45f5470d5ac84cf19821237cb0d22c36 2023-07-12 13:16:18,662 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6bdf38cbc4034179a63c83a0e8deeb51 2023-07-12 13:16:18,662 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/6bdf38cbc4034179a63c83a0e8deeb51, entries=3, sequenceid=23, filesize=5.2 K 2023-07-12 13:16:18,662 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45f5470d5ac84cf19821237cb0d22c36 2023-07-12 13:16:18,662 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/45f5470d5ac84cf19821237cb0d22c36, entries=3, sequenceid=23, filesize=5.2 K 2023-07-12 13:16:18,662 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family2/1887394253794d568550b32e0d8d3b10 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/1887394253794d568550b32e0d8d3b10 2023-07-12 13:16:18,663 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family2/8f5dc6a10d914dbc82d639bc4fac4969 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/8f5dc6a10d914dbc82d639bc4fac4969 2023-07-12 13:16:18,666 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1887394253794d568550b32e0d8d3b10 2023-07-12 13:16:18,666 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/1887394253794d568550b32e0d8d3b10, entries=1, sequenceid=23, filesize=5.0 K 2023-07-12 13:16:18,666 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f5dc6a10d914dbc82d639bc4fac4969 2023-07-12 13:16:18,666 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/8f5dc6a10d914dbc82d639bc4fac4969, entries=1, sequenceid=23, filesize=5.0 K 2023-07-12 13:16:18,667 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d2165571560ffa24987feffa1865ee2c in 1327ms, sequenceid=23, compaction requested=true 2023-07-12 13:16:18,667 INFO [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b9dd93b327e9720e302527e9c2cbf043 in 1327ms, sequenceid=23, compaction requested=true 2023-07-12 13:16:18,667 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2165571560ffa24987feffa1865ee2c: 2023-07-12 13:16:18,667 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b9dd93b327e9720e302527e9c2cbf043: 2023-07-12 13:16:18,667 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:18,667 DEBUG [rs(jenkins-hbase17.apache.org,41721,1689167613545)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:18,667 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-12 13:16:18,667 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-12 13:16:18,667 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-12 13:16:18,667 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,667 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-12 13:16:18,667 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-12 13:16:18,669 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,669 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:18,669 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:18,669 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 13:16:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:18,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:18,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41721,1689167613545' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-12 13:16:18,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63067268[Count = 0] remaining members to acquire global barrier 2023-07-12 13:16:18,670 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-12 13:16:18,670 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:18,670 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:18,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:18,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:18,671 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-12 13:16:18,671 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-12 13:16:18,671 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,671 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 13:16:18,671 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase17.apache.org,41721,1689167613545' in zk 2023-07-12 13:16:18,671 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-12 13:16:18,671 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,671 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:18,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:18,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:18,671 DEBUG [member: 'jenkins-hbase17.apache.org,41721,1689167613545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-12 13:16:18,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:18,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:18,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:18,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:18,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:18,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase17.apache.org,41721,1689167613545': 2023-07-12 13:16:18,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41721,1689167613545' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-12 13:16:18,673 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-12 13:16:18,673 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 13:16:18,673 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 13:16:18,673 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-12 13:16:18,673 INFO [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 13:16:18,674 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:18,674 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:18,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:18,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 13:16:18,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 13:16:18,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:18,674 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:18,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:18,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 13:16:18,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:18,674 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:18,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 13:16:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,675 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 13:16:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-12 13:16:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,676 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,677 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 13:16:18,677 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:18,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 13:16:18,677 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 13:16:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:16:18,677 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-12 13:16:18,677 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 13:16:18,677 DEBUG [(jenkins-hbase17.apache.org,41307,1689167612472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 13:16:18,677 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-12 13:16:18,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 13:16:18,677 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:16:18,677 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:18,677 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-12 13:16:18,677 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-12 13:16:18,677 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-12 13:16:18,677 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-12 13:16:18,777 DEBUG [Listener at localhost.localdomain/44505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 13:16:18,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 13:16:18,779 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:16:18,779 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): ae13b930868feb66fdcc03d9f473ae09/family1 is initiating major compaction (all files) 2023-07-12 13:16:18,779 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:16:18,779 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:16:18,779 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of ae13b930868feb66fdcc03d9f473ae09/family1 in testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:18,779 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/2675a20429b04f6897f175a42e01f3ff, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/518358f5498f43d3baa6a4e547feeacf, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/06ea3c37a7b0485d91c43c54fa985a64, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/c1f5e1ae62314142b353090022f6a14a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/38c1a16fe7f3427d853e5a14862596fb] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp, totalSize=27.1 K 2023-07-12 13:16:18,780 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 2675a20429b04f6897f175a42e01f3ff, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167770887 2023-07-12 13:16:18,781 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 518358f5498f43d3baa6a4e547feeacf, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167772356 2023-07-12 13:16:18,782 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 06ea3c37a7b0485d91c43c54fa985a64, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167773841 2023-07-12 13:16:18,783 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting c1f5e1ae62314142b353090022f6a14a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167775325 2023-07-12 13:16:18,784 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 38c1a16fe7f3427d853e5a14862596fb, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-12 13:16:18,801 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): ae13b930868feb66fdcc03d9f473ae09#family1#compaction#198 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:16:19,250 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230712d4e0f4ca6a5e4f14831d567639663d97_del 2023-07-12 13:16:19,251 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712d4e0f4ca6a5e4f14831d567639663d97_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230712d4e0f4ca6a5e4f14831d567639663d97_del 2023-07-12 13:16:20,108 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 808efb90cd1b4a6bacedf44626f9a08d 2023-07-12 13:16:20,109 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family1/808efb90cd1b4a6bacedf44626f9a08d as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/808efb90cd1b4a6bacedf44626f9a08d 2023-07-12 13:16:20,129 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 808efb90cd1b4a6bacedf44626f9a08d 2023-07-12 13:16:20,130 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ae13b930868feb66fdcc03d9f473ae09/family1 of ae13b930868feb66fdcc03d9f473ae09 into 808efb90cd1b4a6bacedf44626f9a08d(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:16:20,130 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for ae13b930868feb66fdcc03d9f473ae09: 2023-07-12 13:16:20,131 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:16:20,131 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): ae13b930868feb66fdcc03d9f473ae09/family2 is initiating major compaction (all files) 2023-07-12 13:16:20,131 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:16:20,131 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:16:20,131 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of ae13b930868feb66fdcc03d9f473ae09/family2 in testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:20,131 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/2d48c46fa6f14febba2ba2315266471a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/f16d4320ae574a6f8b063ed48d23ea23, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/dbb125bf1e7042ca9765b424783c4f87, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/43e12cbe637b47ba9cacd4db5cc6f812, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/fcc234c866d44d2da73cd0f58346361e] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp, totalSize=25.4 K 2023-07-12 13:16:20,132 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 2d48c46fa6f14febba2ba2315266471a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167770887 2023-07-12 13:16:20,132 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting f16d4320ae574a6f8b063ed48d23ea23, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167772356 2023-07-12 13:16:20,133 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting dbb125bf1e7042ca9765b424783c4f87, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167773841 2023-07-12 13:16:20,133 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 43e12cbe637b47ba9cacd4db5cc6f812, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167775325 2023-07-12 13:16:20,133 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting fcc234c866d44d2da73cd0f58346361e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-12 13:16:20,139 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): ae13b930868feb66fdcc03d9f473ae09#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:16:20,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/2675a20429b04f6897f175a42e01f3ff, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/518358f5498f43d3baa6a4e547feeacf, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/06ea3c37a7b0485d91c43c54fa985a64, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/c1f5e1ae62314142b353090022f6a14a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/38c1a16fe7f3427d853e5a14862596fb] to archive 2023-07-12 13:16:20,169 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:20,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/2675a20429b04f6897f175a42e01f3ff to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/2675a20429b04f6897f175a42e01f3ff 2023-07-12 13:16:20,171 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/518358f5498f43d3baa6a4e547feeacf to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/518358f5498f43d3baa6a4e547feeacf 2023-07-12 13:16:20,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/06ea3c37a7b0485d91c43c54fa985a64 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/06ea3c37a7b0485d91c43c54fa985a64 2023-07-12 13:16:20,173 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/c1f5e1ae62314142b353090022f6a14a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/c1f5e1ae62314142b353090022f6a14a 2023-07-12 13:16:20,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/38c1a16fe7f3427d853e5a14862596fb to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/38c1a16fe7f3427d853e5a14862596fb 2023-07-12 13:16:20,546 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202307120b749ea0527d49e68998c494a23e5697_del 2023-07-12 13:16:20,547 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307120b749ea0527d49e68998c494a23e5697_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202307120b749ea0527d49e68998c494a23e5697_del 2023-07-12 13:16:21,357 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3b7aefb6dfa4b8bb51424bcd0887bb6 2023-07-12 13:16:21,358 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/.tmp/family2/a3b7aefb6dfa4b8bb51424bcd0887bb6 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/a3b7aefb6dfa4b8bb51424bcd0887bb6 2023-07-12 13:16:21,360 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3b7aefb6dfa4b8bb51424bcd0887bb6 2023-07-12 13:16:21,361 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ae13b930868feb66fdcc03d9f473ae09/family2 of ae13b930868feb66fdcc03d9f473ae09 into a3b7aefb6dfa4b8bb51424bcd0887bb6(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:16:21,361 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for ae13b930868feb66fdcc03d9f473ae09: 2023-07-12 13:16:21,361 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:16:21,361 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): b9dd93b327e9720e302527e9c2cbf043/family1 is initiating major compaction (all files) 2023-07-12 13:16:21,362 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:16:21,362 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:16:21,362 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of b9dd93b327e9720e302527e9c2cbf043/family1 in testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:21,362 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/1fd03b9c66a846188ff1764675f6a29f, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/76e8844f1e3c4602834270b70f365929, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/3b7533619e5743efae44282bad5cc182, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/dc30a91c191f4483b65cb319cb340476, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/45f5470d5ac84cf19821237cb0d22c36] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp, totalSize=27.1 K 2023-07-12 13:16:21,362 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 1fd03b9c66a846188ff1764675f6a29f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167770887 2023-07-12 13:16:21,363 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 76e8844f1e3c4602834270b70f365929, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167772356 2023-07-12 13:16:21,363 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 3b7533619e5743efae44282bad5cc182, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167773841 2023-07-12 13:16:21,363 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting dc30a91c191f4483b65cb319cb340476, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167775325 2023-07-12 13:16:21,363 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 45f5470d5ac84cf19821237cb0d22c36, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-12 13:16:21,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/2d48c46fa6f14febba2ba2315266471a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/f16d4320ae574a6f8b063ed48d23ea23, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/dbb125bf1e7042ca9765b424783c4f87, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/43e12cbe637b47ba9cacd4db5cc6f812, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/fcc234c866d44d2da73cd0f58346361e] to archive 2023-07-12 13:16:21,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:21,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/2d48c46fa6f14febba2ba2315266471a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/2d48c46fa6f14febba2ba2315266471a 2023-07-12 13:16:21,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/f16d4320ae574a6f8b063ed48d23ea23 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/f16d4320ae574a6f8b063ed48d23ea23 2023-07-12 13:16:21,371 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): b9dd93b327e9720e302527e9c2cbf043#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:16:21,371 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/dbb125bf1e7042ca9765b424783c4f87 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/dbb125bf1e7042ca9765b424783c4f87 2023-07-12 13:16:21,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/43e12cbe637b47ba9cacd4db5cc6f812 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/43e12cbe637b47ba9cacd4db5cc6f812 2023-07-12 13:16:21,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/fcc234c866d44d2da73cd0f58346361e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family2/fcc234c866d44d2da73cd0f58346361e 2023-07-12 13:16:21,805 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023071236369218b23d493189e3bcc0bb5fad20_del 2023-07-12 13:16:21,805 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071236369218b23d493189e3bcc0bb5fad20_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023071236369218b23d493189e3bcc0bb5fad20_del 2023-07-12 13:16:22,681 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c3a936969ac4e0aa6408f20541fb5fd 2023-07-12 13:16:22,682 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family1/8c3a936969ac4e0aa6408f20541fb5fd as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/8c3a936969ac4e0aa6408f20541fb5fd 2023-07-12 13:16:22,719 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c3a936969ac4e0aa6408f20541fb5fd 2023-07-12 13:16:22,720 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b9dd93b327e9720e302527e9c2cbf043/family1 of b9dd93b327e9720e302527e9c2cbf043 into 8c3a936969ac4e0aa6408f20541fb5fd(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:16:22,720 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for b9dd93b327e9720e302527e9c2cbf043: 2023-07-12 13:16:22,721 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:16:22,721 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): b9dd93b327e9720e302527e9c2cbf043/family2 is initiating major compaction (all files) 2023-07-12 13:16:22,721 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:16:22,721 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:16:22,722 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of b9dd93b327e9720e302527e9c2cbf043/family2 in testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:22,722 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/a222f642d8324f4db28036d8fe24a398, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/335623c4006c47cdbf14c5a18ae3ce64, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/137b74c66cbe4726aaa15c152e6bada3, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/a6bf1a9ff97c468ba12dddcaf7e25c6f, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/8f5dc6a10d914dbc82d639bc4fac4969] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp, totalSize=25.4 K 2023-07-12 13:16:22,722 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting a222f642d8324f4db28036d8fe24a398, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167770887 2023-07-12 13:16:22,723 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 335623c4006c47cdbf14c5a18ae3ce64, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167772356 2023-07-12 13:16:22,724 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 137b74c66cbe4726aaa15c152e6bada3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167773841 2023-07-12 13:16:22,724 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting a6bf1a9ff97c468ba12dddcaf7e25c6f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167775325 2023-07-12 13:16:22,725 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 8f5dc6a10d914dbc82d639bc4fac4969, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-12 13:16:22,737 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): b9dd93b327e9720e302527e9c2cbf043#family2#compaction#201 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:16:22,747 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202307120ec278cbe3e142d49bd57d02546ed3f8_del 2023-07-12 13:16:22,748 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307120ec278cbe3e142d49bd57d02546ed3f8_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202307120ec278cbe3e142d49bd57d02546ed3f8_del 2023-07-12 13:16:22,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/1fd03b9c66a846188ff1764675f6a29f, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/76e8844f1e3c4602834270b70f365929, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/3b7533619e5743efae44282bad5cc182, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/dc30a91c191f4483b65cb319cb340476, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/45f5470d5ac84cf19821237cb0d22c36] to archive 2023-07-12 13:16:22,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:22,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/1fd03b9c66a846188ff1764675f6a29f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/1fd03b9c66a846188ff1764675f6a29f 2023-07-12 13:16:22,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/76e8844f1e3c4602834270b70f365929 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/76e8844f1e3c4602834270b70f365929 2023-07-12 13:16:22,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/3b7533619e5743efae44282bad5cc182 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/3b7533619e5743efae44282bad5cc182 2023-07-12 13:16:22,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/dc30a91c191f4483b65cb319cb340476 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/dc30a91c191f4483b65cb319cb340476 2023-07-12 13:16:22,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/45f5470d5ac84cf19821237cb0d22c36 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/45f5470d5ac84cf19821237cb0d22c36 2023-07-12 13:16:22,794 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14671908b50b4e1c928afdde62eba720 2023-07-12 13:16:22,794 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/.tmp/family2/14671908b50b4e1c928afdde62eba720 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/14671908b50b4e1c928afdde62eba720 2023-07-12 13:16:22,802 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14671908b50b4e1c928afdde62eba720 2023-07-12 13:16:22,803 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b9dd93b327e9720e302527e9c2cbf043/family2 of b9dd93b327e9720e302527e9c2cbf043 into 14671908b50b4e1c928afdde62eba720(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:16:22,803 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for b9dd93b327e9720e302527e9c2cbf043: 2023-07-12 13:16:22,803 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:16:22,803 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): d2165571560ffa24987feffa1865ee2c/family1 is initiating major compaction (all files) 2023-07-12 13:16:22,803 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:16:22,803 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:16:22,803 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of d2165571560ffa24987feffa1865ee2c/family1 in testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:22,803 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/0b437aa291e44698a3c9609a2b9a2b12, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/2de31fad15a24e159422e4c95e083c1a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/b8fdbf34330e47c3bc404730dd8e57e7, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/8378b6bead834679a851a7846968a43f, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/6bdf38cbc4034179a63c83a0e8deeb51] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp, totalSize=27.1 K 2023-07-12 13:16:22,804 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 0b437aa291e44698a3c9609a2b9a2b12, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167770886 2023-07-12 13:16:22,804 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 2de31fad15a24e159422e4c95e083c1a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167772356 2023-07-12 13:16:22,805 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting b8fdbf34330e47c3bc404730dd8e57e7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167773841 2023-07-12 13:16:22,805 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 8378b6bead834679a851a7846968a43f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167775325 2023-07-12 13:16:22,805 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 6bdf38cbc4034179a63c83a0e8deeb51, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-12 13:16:22,828 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): d2165571560ffa24987feffa1865ee2c#family1#compaction#202 average throughput is 0.14 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:16:22,874 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/a222f642d8324f4db28036d8fe24a398, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/335623c4006c47cdbf14c5a18ae3ce64, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/137b74c66cbe4726aaa15c152e6bada3, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/a6bf1a9ff97c468ba12dddcaf7e25c6f, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/8f5dc6a10d914dbc82d639bc4fac4969] to archive 2023-07-12 13:16:22,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:22,876 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/a222f642d8324f4db28036d8fe24a398 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/a222f642d8324f4db28036d8fe24a398 2023-07-12 13:16:22,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/335623c4006c47cdbf14c5a18ae3ce64 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/335623c4006c47cdbf14c5a18ae3ce64 2023-07-12 13:16:22,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/137b74c66cbe4726aaa15c152e6bada3 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/137b74c66cbe4726aaa15c152e6bada3 2023-07-12 13:16:22,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/a6bf1a9ff97c468ba12dddcaf7e25c6f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/a6bf1a9ff97c468ba12dddcaf7e25c6f 2023-07-12 13:16:22,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/8f5dc6a10d914dbc82d639bc4fac4969 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family2/8f5dc6a10d914dbc82d639bc4fac4969 2023-07-12 13:16:23,263 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202307129f66d55d96254002b5d5e708bfd9d58a_del 2023-07-12 13:16:23,263 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307129f66d55d96254002b5d5e708bfd9d58a_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202307129f66d55d96254002b5d5e708bfd9d58a_del 2023-07-12 13:16:24,123 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 364536efa1e74d0b88a235f0a607728d 2023-07-12 13:16:24,124 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family1/364536efa1e74d0b88a235f0a607728d as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/364536efa1e74d0b88a235f0a607728d 2023-07-12 13:16:24,142 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 364536efa1e74d0b88a235f0a607728d 2023-07-12 13:16:24,142 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d2165571560ffa24987feffa1865ee2c/family1 of d2165571560ffa24987feffa1865ee2c into 364536efa1e74d0b88a235f0a607728d(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-12 13:16:24,143 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for d2165571560ffa24987feffa1865ee2c: 2023-07-12 13:16:24,143 DEBUG [Listener at localhost.localdomain/44505] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-12 13:16:24,143 DEBUG [Listener at localhost.localdomain/44505] regionserver.HStore(1912): d2165571560ffa24987feffa1865ee2c/family2 is initiating major compaction (all files) 2023-07-12 13:16:24,143 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:16:24,143 INFO [Listener at localhost.localdomain/44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:16:24,144 INFO [Listener at localhost.localdomain/44505] regionserver.HRegion(2259): Starting compaction of d2165571560ffa24987feffa1865ee2c/family2 in testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:24,144 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/980bc5eec19940068c31623cfc1abd1b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/9b75b84e8c3946728ef6dbdd0168b1c4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/9aaca5753c0f4b7d85ab38d28de4c8f8, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/50330285ae4548aa90cac8e374d1ac80, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/1887394253794d568550b32e0d8d3b10] into tmpdir=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp, totalSize=25.4 K 2023-07-12 13:16:24,145 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 980bc5eec19940068c31623cfc1abd1b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689167770886 2023-07-12 13:16:24,145 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 9b75b84e8c3946728ef6dbdd0168b1c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689167772356 2023-07-12 13:16:24,146 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 9aaca5753c0f4b7d85ab38d28de4c8f8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689167773841 2023-07-12 13:16:24,146 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 50330285ae4548aa90cac8e374d1ac80, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689167775325 2023-07-12 13:16:24,146 DEBUG [Listener at localhost.localdomain/44505] compactions.Compactor(207): Compacting 1887394253794d568550b32e0d8d3b10, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-12 13:16:24,153 INFO [Listener at localhost.localdomain/44505] throttle.PressureAwareThroughputController(145): d2165571560ffa24987feffa1865ee2c#family2#compaction#203 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 13:16:24,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/0b437aa291e44698a3c9609a2b9a2b12, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/2de31fad15a24e159422e4c95e083c1a, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/b8fdbf34330e47c3bc404730dd8e57e7, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/8378b6bead834679a851a7846968a43f, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/6bdf38cbc4034179a63c83a0e8deeb51] to archive 2023-07-12 13:16:24,171 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:24,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/0b437aa291e44698a3c9609a2b9a2b12 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/0b437aa291e44698a3c9609a2b9a2b12 2023-07-12 13:16:24,173 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/2de31fad15a24e159422e4c95e083c1a to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/2de31fad15a24e159422e4c95e083c1a 2023-07-12 13:16:24,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/b8fdbf34330e47c3bc404730dd8e57e7 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/b8fdbf34330e47c3bc404730dd8e57e7 2023-07-12 13:16:24,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/8378b6bead834679a851a7846968a43f to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/8378b6bead834679a851a7846968a43f 2023-07-12 13:16:24,177 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/6bdf38cbc4034179a63c83a0e8deeb51 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/6bdf38cbc4034179a63c83a0e8deeb51 2023-07-12 13:16:24,560 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230712ea16022d4cc848d49338902dacddbfec_del 2023-07-12 13:16:24,560 INFO [Listener at localhost.localdomain/44505] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712ea16022d4cc848d49338902dacddbfec_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230712ea16022d4cc848d49338902dacddbfec_del 2023-07-12 13:16:24,672 DEBUG [regionserver/jenkins-hbase17:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-07-12 13:16:24,970 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 635d27cf73d34719a8360aa4a7eebdaa 2023-07-12 13:16:24,970 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/.tmp/family2/635d27cf73d34719a8360aa4a7eebdaa as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/635d27cf73d34719a8360aa4a7eebdaa 2023-07-12 13:16:24,973 INFO [Listener at localhost.localdomain/44505] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 635d27cf73d34719a8360aa4a7eebdaa 2023-07-12 13:16:24,974 INFO [Listener at localhost.localdomain/44505] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d2165571560ffa24987feffa1865ee2c/family2 of d2165571560ffa24987feffa1865ee2c into 635d27cf73d34719a8360aa4a7eebdaa(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 13:16:24,974 DEBUG [Listener at localhost.localdomain/44505] regionserver.HRegion(2289): Compaction status journal for d2165571560ffa24987feffa1865ee2c: 2023-07-12 13:16:24,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/980bc5eec19940068c31623cfc1abd1b, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/9b75b84e8c3946728ef6dbdd0168b1c4, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/9aaca5753c0f4b7d85ab38d28de4c8f8, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/50330285ae4548aa90cac8e374d1ac80, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/1887394253794d568550b32e0d8d3b10] to archive 2023-07-12 13:16:24,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:24,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/980bc5eec19940068c31623cfc1abd1b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/980bc5eec19940068c31623cfc1abd1b 2023-07-12 13:16:24,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/9b75b84e8c3946728ef6dbdd0168b1c4 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/9b75b84e8c3946728ef6dbdd0168b1c4 2023-07-12 13:16:24,977 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:16:24,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/9aaca5753c0f4b7d85ab38d28de4c8f8 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/9aaca5753c0f4b7d85ab38d28de4c8f8 2023-07-12 13:16:24,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/50330285ae4548aa90cac8e374d1ac80 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/50330285ae4548aa90cac8e374d1ac80 2023-07-12 13:16:24,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/1887394253794d568550b32e0d8d3b10 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family2/1887394253794d568550b32e0d8d3b10 2023-07-12 13:16:24,981 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:16:24,984 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:16:24,985 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:16:24,989 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA5\xFD\x5C\xE1\x0E\xED\x06\x17\xA6+\xB9\xA2\xCC\xA6o)"\x107\x9D\xDD<\x96\x82qBr\xD4\xB9\x006\xA3\xE3l*\x10G\xA7\x90\x92\x1F\x82\xBA.\x87\xB3.\xD4\xDC5\xE1\xE62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-07-12 13:16:25,010 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-07-12 13:16:25,011 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-07-12 13:16:25,011 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:16:25,011 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689168385011 2023-07-12 13:16:25,012 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-12 13:16:25,331 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-07-12 13:16:25,359 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202307129f66d55d96254002b5d5e708bfd9d58a_del 2023-07-12 13:16:25,383 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023071236369218b23d493189e3bcc0bb5fad20_del 2023-07-12 13:16:25,402 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230712d4e0f4ca6a5e4f14831d567639663d97_del 2023-07-12 13:16:25,402 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-07-12 13:16:25,402 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] zookeeper.ReadOnlyZKClient(139): Connect 0x76e0f63a to 127.0.0.1:51470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:16:25,406 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58bcde02, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:16:25,406 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230712 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-12 13:16:26,373 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071298f7f657114e464b9f2b4cedcf8dce1c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023071298f7f657114e464b9f2b4cedcf8dce1c 2023-07-12 13:16:26,375 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230712 table='testMajorCompactionFromAdmin' column='family1' 2023-07-12 13:16:26,393 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:16:26,397 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:16:26,410 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:16:26,413 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:16:26,473 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230712/family1/dd0b8f5ffae543449784a95b6f094144 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-07-12 13:16:26,474 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230712/family1/dd0b8f5ffae543449784a95b6f094144}] 2023-07-12 13:16:26,495 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230712/family1/dd0b8f5ffae543449784a95b6f094144 for inclusion in d2165571560ffa24987feffa1865ee2c/family1 2023-07-12 13:16:26,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-07-12 13:16:26,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(777): Region bounds: first= last=1 2023-07-12 13:16:26,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for d2165571560ffa24987feffa1865ee2c: 2023-07-12 13:16:26,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230712/family1/dd0b8f5ffae543449784a95b6f094144 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__250dkbte3reu8ei6go7o7htij34j1psp3u768f4av31jf1ei3la9umv67mtdkjm1/family1/dd0b8f5ffae543449784a95b6f094144 2023-07-12 13:16:26,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__250dkbte3reu8ei6go7o7htij34j1psp3u768f4av31jf1ei3la9umv67mtdkjm1/family1/dd0b8f5ffae543449784a95b6f094144 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/f17cbba8b00d4e8f812e7699b602580d_SeqId_28_ 2023-07-12 13:16:26,556 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__250dkbte3reu8ei6go7o7htij34j1psp3u768f4av31jf1ei3la9umv67mtdkjm1/family1/dd0b8f5ffae543449784a95b6f094144 into d2165571560ffa24987feffa1865ee2c/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/f17cbba8b00d4e8f812e7699b602580d_SeqId_28_ - updating store file list. 2023-07-12 13:16:26,633 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/f17cbba8b00d4e8f812e7699b602580d_SeqId_28_ into d2165571560ffa24987feffa1865ee2c/family1 2023-07-12 13:16:26,633 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__250dkbte3reu8ei6go7o7htij34j1psp3u768f4av31jf1ei3la9umv67mtdkjm1/family1/dd0b8f5ffae543449784a95b6f094144 into d2165571560ffa24987feffa1865ee2c/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/family1/f17cbba8b00d4e8f812e7699b602580d_SeqId_28_) 2023-07-12 13:16:26,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__250dkbte3reu8ei6go7o7htij34j1psp3u768f4av31jf1ei3la9umv67mtdkjm1/family1/dd0b8f5ffae543449784a95b6f094144 2023-07-12 13:16:26,637 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230712 table='testMajorCompactionFromAdmin' column='family1' 2023-07-12 13:16:26,638 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:26,641 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023071246dea9f2edb146c9bb33423ed7bc0b24 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023071246dea9f2edb146c9bb33423ed7bc0b24 2023-07-12 13:16:26,642 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230712a3589694f7c34b3da9786e4c093246d9 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230712a3589694f7c34b3da9786e4c093246d9 2023-07-12 13:16:26,645 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230712d68ff129d4c84649821d0d792ef24d1c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230712d68ff129d4c84649821d0d792ef24d1c 2023-07-12 13:16:26,646 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230712e50c4b3c3d614bc482ea2f76cc5f19fb to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230712e50c4b3c3d614bc482ea2f76cc5f19fb 2023-07-12 13:16:26,647 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-07-12 13:16:26,647 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230712' 2023-07-12 13:16:26,647 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230712 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-12 13:16:26,648 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230712 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-12 13:16:26,906 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230712914fb93225ad42258beb62ea03027b6c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230712914fb93225ad42258beb62ea03027b6c 2023-07-12 13:16:26,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230712 table='testMajorCompactionFromAdmin' column='family1' 2023-07-12 13:16:26,952 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230712/family1/054a3d60b6614418bcb18b1b4e3606b7 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-07-12 13:16:26,953 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230712/family1/054a3d60b6614418bcb18b1b4e3606b7}] 2023-07-12 13:16:26,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230712/family1/054a3d60b6614418bcb18b1b4e3606b7 for inclusion in ae13b930868feb66fdcc03d9f473ae09/family1 2023-07-12 13:16:26,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-07-12 13:16:26,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-12 13:16:26,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for ae13b930868feb66fdcc03d9f473ae09: 2023-07-12 13:16:26,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230712/family1/054a3d60b6614418bcb18b1b4e3606b7 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__bjupvk048pmcoqnnb3t9018d3tsng4eahmou04d36nqeqjvatcf3vdmuvo8bia4v/family1/054a3d60b6614418bcb18b1b4e3606b7 2023-07-12 13:16:26,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__bjupvk048pmcoqnnb3t9018d3tsng4eahmou04d36nqeqjvatcf3vdmuvo8bia4v/family1/054a3d60b6614418bcb18b1b4e3606b7 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/f491373b86464727b7d4cdbc24271cc4_SeqId_28_ 2023-07-12 13:16:26,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__bjupvk048pmcoqnnb3t9018d3tsng4eahmou04d36nqeqjvatcf3vdmuvo8bia4v/family1/054a3d60b6614418bcb18b1b4e3606b7 into ae13b930868feb66fdcc03d9f473ae09/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/f491373b86464727b7d4cdbc24271cc4_SeqId_28_ - updating store file list. 2023-07-12 13:16:27,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/f491373b86464727b7d4cdbc24271cc4_SeqId_28_ into ae13b930868feb66fdcc03d9f473ae09/family1 2023-07-12 13:16:27,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__bjupvk048pmcoqnnb3t9018d3tsng4eahmou04d36nqeqjvatcf3vdmuvo8bia4v/family1/054a3d60b6614418bcb18b1b4e3606b7 into ae13b930868feb66fdcc03d9f473ae09/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/family1/f491373b86464727b7d4cdbc24271cc4_SeqId_28_) 2023-07-12 13:16:27,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__bjupvk048pmcoqnnb3t9018d3tsng4eahmou04d36nqeqjvatcf3vdmuvo8bia4v/family1/054a3d60b6614418bcb18b1b4e3606b7 2023-07-12 13:16:27,007 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230712 table='testMajorCompactionFromAdmin' column='family1' 2023-07-12 13:16:27,007 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:27,009 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230712348313a350bd42abb15c4c39de103332 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230712348313a350bd42abb15c4c39de103332 2023-07-12 13:16:27,009 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023071242140dd731c342818f9a5ce9afcc0d61 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023071242140dd731c342818f9a5ce9afcc0d61 2023-07-12 13:16:27,010 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307129ba637e4f9d4423daebdb41d4e0714e2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307129ba637e4f9d4423daebdb41d4e0714e2 2023-07-12 13:16:27,011 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230712cb2a17025bca4e72a72b0cfb5a9a0994 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230712cb2a17025bca4e72a72b0cfb5a9a0994 2023-07-12 13:16:27,011 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-07-12 13:16:27,011 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230712' 2023-07-12 13:16:27,011 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230712 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-12 13:16:27,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230712 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-12 13:16:27,967 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712dc7789066d194ac18771d8d592793e4c to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230712dc7789066d194ac18771d8d592793e4c 2023-07-12 13:16:27,967 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230712 table='testMajorCompactionFromAdmin' column='family1' 2023-07-12 13:16:28,016 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230712/family1/9e589c6a6fa5489dbc39eebd66f3fb31 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-07-12 13:16:28,017 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043., hostname=jenkins-hbase17.apache.org,41721,1689167613545, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230712/family1/9e589c6a6fa5489dbc39eebd66f3fb31}] 2023-07-12 13:16:28,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230712/family1/9e589c6a6fa5489dbc39eebd66f3fb31 for inclusion in b9dd93b327e9720e302527e9c2cbf043/family1 2023-07-12 13:16:28,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-07-12 13:16:28,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(777): Region bounds: first=1 last=2 2023-07-12 13:16:28,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(2446): Flush status journal for b9dd93b327e9720e302527e9c2cbf043: 2023-07-12 13:16:28,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230712/family1/9e589c6a6fa5489dbc39eebd66f3fb31 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__9qbtt9ms3iotjk14jurtp3j9h0dvt9illkhjspquvjlhlve1ecsqnl6k7e21m6p/family1/9e589c6a6fa5489dbc39eebd66f3fb31 2023-07-12 13:16:28,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__9qbtt9ms3iotjk14jurtp3j9h0dvt9illkhjspquvjlhlve1ecsqnl6k7e21m6p/family1/9e589c6a6fa5489dbc39eebd66f3fb31 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/e1790c5c526d4fcca131059069c2bb14_SeqId_28_ 2023-07-12 13:16:28,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__9qbtt9ms3iotjk14jurtp3j9h0dvt9illkhjspquvjlhlve1ecsqnl6k7e21m6p/family1/9e589c6a6fa5489dbc39eebd66f3fb31 into b9dd93b327e9720e302527e9c2cbf043/family1 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/e1790c5c526d4fcca131059069c2bb14_SeqId_28_ - updating store file list. 2023-07-12 13:16:28,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/e1790c5c526d4fcca131059069c2bb14_SeqId_28_ into b9dd93b327e9720e302527e9c2cbf043/family1 2023-07-12 13:16:28,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__9qbtt9ms3iotjk14jurtp3j9h0dvt9illkhjspquvjlhlve1ecsqnl6k7e21m6p/family1/9e589c6a6fa5489dbc39eebd66f3fb31 into b9dd93b327e9720e302527e9c2cbf043/family1 (new location: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/family1/e1790c5c526d4fcca131059069c2bb14_SeqId_28_) 2023-07-12 13:16:28,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/staging/jenkins__testMajorCompactionFromAdmin__9qbtt9ms3iotjk14jurtp3j9h0dvt9illkhjspquvjlhlve1ecsqnl6k7e21m6p/family1/9e589c6a6fa5489dbc39eebd66f3fb31 2023-07-12 13:16:28,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230712 table='testMajorCompactionFromAdmin' column='family1' 2023-07-12 13:16:28,077 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:28,078 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202307120f36cb55b4444fb38315c76fbbfb368b to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202307120f36cb55b4444fb38315c76fbbfb368b 2023-07-12 13:16:28,079 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230712869cdd7e8a8648eba4da5d549bc310e2 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230712869cdd7e8a8648eba4da5d549bc310e2 2023-07-12 13:16:28,080 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230712b4ab6fa0b1f548f2a18d188355b17c9e to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230712b4ab6fa0b1f548f2a18d188355b17c9e 2023-07-12 13:16:28,081 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230712d05a58402fbe401f975a49de0d5ec448 to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230712d05a58402fbe401f975a49de0d5ec448 2023-07-12 13:16:28,081 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-07-12 13:16:28,081 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230712' 2023-07-12 13:16:28,081 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230712 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-12 13:16:28,081 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-07-12 13:16:28,081 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-12 13:16:28,081 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202307129f66d55d96254002b5d5e708bfd9d58a_del] 2023-07-12 13:16:28,082 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:28,083 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202307129f66d55d96254002b5d5e708bfd9d58a_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202307129f66d55d96254002b5d5e708bfd9d58a_del 2023-07-12 13:16:28,083 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-07-12 13:16:28,083 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023071236369218b23d493189e3bcc0bb5fad20_del] 2023-07-12 13:16:28,083 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:28,084 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023071236369218b23d493189e3bcc0bb5fad20_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023071236369218b23d493189e3bcc0bb5fad20_del 2023-07-12 13:16:28,084 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-07-12 13:16:28,084 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230712d4e0f4ca6a5e4f14831d567639663d97_del] 2023-07-12 13:16:28,085 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 13:16:28,085 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230712d4e0f4ca6a5e4f14831d567639663d97_del to hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230712d4e0f4ca6a5e4f14831d567639663d97_del 2023-07-12 13:16:28,086 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-07-12 13:16:28,086 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1689167616937] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-12 13:16:28,086 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-07-12 13:16:28,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.0770 sec 2023-07-12 13:16:28,106 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:16:28,109 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:16:28,112 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-12 13:16:28,112 DEBUG [Listener at localhost.localdomain/44505] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-12 13:16:28,119 INFO [Listener at localhost.localdomain/44505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:16:28,162 INFO [Listener at localhost.localdomain/44505] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=249 (was 253), OpenFileDescriptor=638 (was 641), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 159) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=7635 (was 7729) 2023-07-12 13:16:28,162 DEBUG [Listener at localhost.localdomain/44505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4939d43d to 127.0.0.1:51470 2023-07-12 13:16:28,163 DEBUG [Listener at localhost.localdomain/44505] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:16:28,163 INFO [Listener at localhost.localdomain/44505] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 13:16:28,163 INFO [Listener at localhost.localdomain/44505] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:16:28,163 DEBUG [Listener at localhost.localdomain/44505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ce7946e to 127.0.0.1:51470 2023-07-12 13:16:28,163 DEBUG [Listener at localhost.localdomain/44505] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:16:28,163 DEBUG [Listener at localhost.localdomain/44505] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 13:16:28,163 DEBUG [Listener at localhost.localdomain/44505] util.JVMClusterUtil(257): Found active master hash=683600091, stopped=false 2023-07-12 13:16:28,163 INFO [Listener at localhost.localdomain/44505] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,41307,1689167612472 2023-07-12 13:16:28,164 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 13:16:28,164 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 13:16:28,165 INFO [Listener at localhost.localdomain/44505] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 13:16:28,165 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:16:28,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 13:16:28,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 13:16:28,165 DEBUG [Listener at localhost.localdomain/44505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57f02321 to 127.0.0.1:51470 2023-07-12 13:16:28,165 DEBUG [Listener at localhost.localdomain/44505] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:16:28,166 INFO [Listener at localhost.localdomain/44505] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,41721,1689167613545' ***** 2023-07-12 13:16:28,166 INFO [Listener at localhost.localdomain/44505] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 13:16:28,166 INFO [RS:0;jenkins-hbase17:41721] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 13:16:28,166 INFO [RS:0;jenkins-hbase17:41721] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 13:16:28,166 INFO [RS:0;jenkins-hbase17:41721] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 13:16:28,166 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 13:16:28,166 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for 0d3aa80d7fb53bdf2708c0638951744d 2023-07-12 13:16:28,167 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for d5f7aa412574761e5532007a732652e2 2023-07-12 13:16:28,167 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for d10e316608e6877e6e7709797b53ca2d 2023-07-12 13:16:28,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0d3aa80d7fb53bdf2708c0638951744d, disabling compactions & flushes 2023-07-12 13:16:28,167 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for ae13b930868feb66fdcc03d9f473ae09 2023-07-12 13:16:28,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:16:28,167 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for 8dbdd1e58659f82914d0046114f39095 2023-07-12 13:16:28,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:16:28,167 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for a34870d754173c6eb017e5976ddb69b1 2023-07-12 13:16:28,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. after waiting 0 ms 2023-07-12 13:16:28,167 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for 76d13adf9ec2fbd57aa0f03e10ecb66d 2023-07-12 13:16:28,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:16:28,167 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for ca4cc2441077e8f17b6c92a4389107ba 2023-07-12 13:16:28,167 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for 0bbe9e37b47558540911eb888d91fed0 2023-07-12 13:16:28,167 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for c46245c314248bd04561756602a12831 2023-07-12 13:16:28,167 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for 684e9c34724c737ee5eb5d368452e637 2023-07-12 13:16:28,167 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for b6038e0f3438cfc9edf31b7dc8e36aab 2023-07-12 13:16:28,167 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for b9dd93b327e9720e302527e9c2cbf043 2023-07-12 13:16:28,167 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for 9c3dd1c27a1a45c43f96b95fb3aa34b8 2023-07-12 13:16:28,167 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for c9662635c9aef48a82b6818321244591 2023-07-12 13:16:28,168 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for d615b79ac3c7ed8fb72118637ae048e6 2023-07-12 13:16:28,168 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for 2957a9c4bee7f52d38ac5e9cd8c8d4c1 2023-07-12 13:16:28,168 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for e60e2238d684b9eda52028c97b0e4a2e 2023-07-12 13:16:28,168 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for b4c48074f460d6e2d7b4c30203b98f50 2023-07-12 13:16:28,168 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for d2165571560ffa24987feffa1865ee2c 2023-07-12 13:16:28,168 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:28,168 DEBUG [RS:0;jenkins-hbase17:41721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4df55a13 to 127.0.0.1:51470 2023-07-12 13:16:28,168 DEBUG [RS:0;jenkins-hbase17:41721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:16:28,168 INFO [RS:0;jenkins-hbase17:41721] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 13:16:28,168 INFO [RS:0;jenkins-hbase17:41721] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 13:16:28,169 INFO [RS:0;jenkins-hbase17:41721] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 13:16:28,169 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 13:16:28,169 INFO [regionserver/jenkins-hbase17:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-07-12 13:16:28,169 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-07-12 13:16:28,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 13:16:28,169 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 13:16:28,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 13:16:28,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 13:16:28,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 13:16:28,169 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-07-12 13:16:28,170 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1504): Waiting on 0bbe9e37b47558540911eb888d91fed0, 0d3aa80d7fb53bdf2708c0638951744d, 1588230740, 2957a9c4bee7f52d38ac5e9cd8c8d4c1, 684e9c34724c737ee5eb5d368452e637, 76d13adf9ec2fbd57aa0f03e10ecb66d, 8dbdd1e58659f82914d0046114f39095, 9c3dd1c27a1a45c43f96b95fb3aa34b8, a34870d754173c6eb017e5976ddb69b1, ae13b930868feb66fdcc03d9f473ae09, b4c48074f460d6e2d7b4c30203b98f50, b6038e0f3438cfc9edf31b7dc8e36aab, b9dd93b327e9720e302527e9c2cbf043, c46245c314248bd04561756602a12831, c9662635c9aef48a82b6818321244591, ca4cc2441077e8f17b6c92a4389107ba, d10e316608e6877e6e7709797b53ca2d, d2165571560ffa24987feffa1865ee2c, d5f7aa412574761e5532007a732652e2, d615b79ac3c7ed8fb72118637ae048e6, e60e2238d684b9eda52028c97b0e4a2e 2023-07-12 13:16:28,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/0d3aa80d7fb53bdf2708c0638951744d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-07-12 13:16:28,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:16:28,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0d3aa80d7fb53bdf2708c0638951744d: 2023-07-12 13:16:28,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1689167654661.0d3aa80d7fb53bdf2708c0638951744d. 2023-07-12 13:16:28,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing d5f7aa412574761e5532007a732652e2, disabling compactions & flushes 2023-07-12 13:16:28,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:16:28,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:16:28,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. after waiting 0 ms 2023-07-12 13:16:28,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:16:28,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/d5f7aa412574761e5532007a732652e2/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-07-12 13:16:28,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:16:28,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for d5f7aa412574761e5532007a732652e2: 2023-07-12 13:16:28,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1689167654661.d5f7aa412574761e5532007a732652e2. 2023-07-12 13:16:28,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing d10e316608e6877e6e7709797b53ca2d, disabling compactions & flushes 2023-07-12 13:16:28,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:16:28,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:16:28,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. after waiting 0 ms 2023-07-12 13:16:28,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:16:28,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/d10e316608e6877e6e7709797b53ca2d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-12 13:16:28,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:16:28,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for d10e316608e6877e6e7709797b53ca2d: 2023-07-12 13:16:28,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1689167737375.d10e316608e6877e6e7709797b53ca2d. 2023-07-12 13:16:28,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing ae13b930868feb66fdcc03d9f473ae09, disabling compactions & flushes 2023-07-12 13:16:28,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:28,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:28,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. after waiting 0 ms 2023-07-12 13:16:28,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:28,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/ae13b930868feb66fdcc03d9f473ae09/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-12 13:16:28,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:28,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for ae13b930868feb66fdcc03d9f473ae09: 2023-07-12 13:16:28,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1689167768741.ae13b930868feb66fdcc03d9f473ae09. 2023-07-12 13:16:28,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 8dbdd1e58659f82914d0046114f39095, disabling compactions & flushes 2023-07-12 13:16:28,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:16:28,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:16:28,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. after waiting 0 ms 2023-07-12 13:16:28,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:16:28,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithWeeklyPolicy/8dbdd1e58659f82914d0046114f39095/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-07-12 13:16:28,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:16:28,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 8dbdd1e58659f82914d0046114f39095: 2023-07-12 13:16:28,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1689167642957.8dbdd1e58659f82914d0046114f39095. 2023-07-12 13:16:28,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a34870d754173c6eb017e5976ddb69b1, disabling compactions & flushes 2023-07-12 13:16:28,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:16:28,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:16:28,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. after waiting 0 ms 2023-07-12 13:16:28,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:16:28,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/a34870d754173c6eb017e5976ddb69b1/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-12 13:16:28,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:16:28,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a34870d754173c6eb017e5976ddb69b1: 2023-07-12 13:16:28,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1689167737375.a34870d754173c6eb017e5976ddb69b1. 2023-07-12 13:16:28,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 76d13adf9ec2fbd57aa0f03e10ecb66d, disabling compactions & flushes 2023-07-12 13:16:28,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:16:28,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:16:28,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. after waiting 0 ms 2023-07-12 13:16:28,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:16:28,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/ns/testMinorCompaction/76d13adf9ec2fbd57aa0f03e10ecb66d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-12 13:16:28,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:16:28,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 76d13adf9ec2fbd57aa0f03e10ecb66d: 2023-07-12 13:16:28,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1689167737375.76d13adf9ec2fbd57aa0f03e10ecb66d. 2023-07-12 13:16:28,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing ca4cc2441077e8f17b6c92a4389107ba, disabling compactions & flushes 2023-07-12 13:16:28,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba. 2023-07-12 13:16:28,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba. 2023-07-12 13:16:28,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba. after waiting 0 ms 2023-07-12 13:16:28,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba. 2023-07-12 13:16:28,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing ca4cc2441077e8f17b6c92a4389107ba 1/1 column families, dataSize=109 B heapSize=592 B 2023-07-12 13:16:28,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/namespace/ca4cc2441077e8f17b6c92a4389107ba/.tmp/info/186d3563f4814aa398965a513808a214 2023-07-12 13:16:28,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/namespace/ca4cc2441077e8f17b6c92a4389107ba/.tmp/info/186d3563f4814aa398965a513808a214 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/namespace/ca4cc2441077e8f17b6c92a4389107ba/info/186d3563f4814aa398965a513808a214 2023-07-12 13:16:28,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/namespace/ca4cc2441077e8f17b6c92a4389107ba/info/186d3563f4814aa398965a513808a214, entries=3, sequenceid=7, filesize=4.8 K 2023-07-12 13:16:28,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for ca4cc2441077e8f17b6c92a4389107ba in 13ms, sequenceid=7, compaction requested=false 2023-07-12 13:16:28,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/namespace/ca4cc2441077e8f17b6c92a4389107ba/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-07-12 13:16:28,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba. 2023-07-12 13:16:28,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for ca4cc2441077e8f17b6c92a4389107ba: 2023-07-12 13:16:28,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689167615408.ca4cc2441077e8f17b6c92a4389107ba. 2023-07-12 13:16:28,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0bbe9e37b47558540911eb888d91fed0, disabling compactions & flushes 2023-07-12 13:16:28,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:16:28,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:16:28,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. after waiting 0 ms 2023-07-12 13:16:28,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:16:28,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0bbe9e37b47558540911eb888d91fed0/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-07-12 13:16:28,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:16:28,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0bbe9e37b47558540911eb888d91fed0: 2023-07-12 13:16:28,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689167688909.0bbe9e37b47558540911eb888d91fed0. 2023-07-12 13:16:28,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing c46245c314248bd04561756602a12831, disabling compactions & flushes 2023-07-12 13:16:28,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:16:28,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:16:28,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. after waiting 0 ms 2023-07-12 13:16:28,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:16:28,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c46245c314248bd04561756602a12831/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-07-12 13:16:28,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:16:28,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for c46245c314248bd04561756602a12831: 2023-07-12 13:16:28,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1689167617107.c46245c314248bd04561756602a12831. 2023-07-12 13:16:28,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 684e9c34724c737ee5eb5d368452e637, disabling compactions & flushes 2023-07-12 13:16:28,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:16:28,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:16:28,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. after waiting 0 ms 2023-07-12 13:16:28,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:16:28,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/684e9c34724c737ee5eb5d368452e637/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-07-12 13:16:28,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:16:28,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 684e9c34724c737ee5eb5d368452e637: 2023-07-12 13:16:28,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1689167709914.684e9c34724c737ee5eb5d368452e637. 2023-07-12 13:16:28,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing b6038e0f3438cfc9edf31b7dc8e36aab, disabling compactions & flushes 2023-07-12 13:16:28,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:16:28,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:16:28,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. after waiting 0 ms 2023-07-12 13:16:28,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:16:28,234 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 13:16:28,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testScannerOnBulkLoadRefHFiles/b6038e0f3438cfc9edf31b7dc8e36aab/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-07-12 13:16:28,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:16:28,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for b6038e0f3438cfc9edf31b7dc8e36aab: 2023-07-12 13:16:28,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1689167654661.b6038e0f3438cfc9edf31b7dc8e36aab. 2023-07-12 13:16:28,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing b9dd93b327e9720e302527e9c2cbf043, disabling compactions & flushes 2023-07-12 13:16:28,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:28,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:28,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. after waiting 0 ms 2023-07-12 13:16:28,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:28,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/b9dd93b327e9720e302527e9c2cbf043/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-12 13:16:28,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:28,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for b9dd93b327e9720e302527e9c2cbf043: 2023-07-12 13:16:28,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1689167768741.b9dd93b327e9720e302527e9c2cbf043. 2023-07-12 13:16:28,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 9c3dd1c27a1a45c43f96b95fb3aa34b8, disabling compactions & flushes 2023-07-12 13:16:28,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:16:28,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:16:28,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. after waiting 0 ms 2023-07-12 13:16:28,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:16:28,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/9c3dd1c27a1a45c43f96b95fb3aa34b8/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-07-12 13:16:28,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:16:28,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 9c3dd1c27a1a45c43f96b95fb3aa34b8: 2023-07-12 13:16:28,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1689167709914.9c3dd1c27a1a45c43f96b95fb3aa34b8. 2023-07-12 13:16:28,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing c9662635c9aef48a82b6818321244591, disabling compactions & flushes 2023-07-12 13:16:28,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:16:28,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:16:28,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. after waiting 0 ms 2023-07-12 13:16:28,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:16:28,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testCompactionWithHFileLink/c9662635c9aef48a82b6818321244591/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-07-12 13:16:28,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:16:28,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for c9662635c9aef48a82b6818321244591: 2023-07-12 13:16:28,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1689167709914.c9662635c9aef48a82b6818321244591. 2023-07-12 13:16:28,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing d615b79ac3c7ed8fb72118637ae048e6, disabling compactions & flushes 2023-07-12 13:16:28,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:28,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:28,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. after waiting 0 ms 2023-07-12 13:16:28,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:28,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMinorCompactionWithMonthlyPolicy/d615b79ac3c7ed8fb72118637ae048e6/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-07-12 13:16:28,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:28,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for d615b79ac3c7ed8fb72118637ae048e6: 2023-07-12 13:16:28,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1689167755865.d615b79ac3c7ed8fb72118637ae048e6. 2023-07-12 13:16:28,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 2957a9c4bee7f52d38ac5e9cd8c8d4c1, disabling compactions & flushes 2023-07-12 13:16:28,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:16:28,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:16:28,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. after waiting 0 ms 2023-07-12 13:16:28,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:16:28,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2957a9c4bee7f52d38ac5e9cd8c8d4c1/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-07-12 13:16:28,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:16:28,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 2957a9c4bee7f52d38ac5e9cd8c8d4c1: 2023-07-12 13:16:28,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689167672464.2957a9c4bee7f52d38ac5e9cd8c8d4c1. 2023-07-12 13:16:28,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e60e2238d684b9eda52028c97b0e4a2e, disabling compactions & flushes 2023-07-12 13:16:28,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:16:28,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:16:28,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. after waiting 0 ms 2023-07-12 13:16:28,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:16:28,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithMonthlyPolicy/e60e2238d684b9eda52028c97b0e4a2e/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-07-12 13:16:28,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:16:28,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e60e2238d684b9eda52028c97b0e4a2e: 2023-07-12 13:16:28,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1689167630368.e60e2238d684b9eda52028c97b0e4a2e. 2023-07-12 13:16:28,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing b4c48074f460d6e2d7b4c30203b98f50, disabling compactions & flushes 2023-07-12 13:16:28,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:16:28,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:16:28,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. after waiting 0 ms 2023-07-12 13:16:28,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:16:28,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionWithWeeklyPolicy/b4c48074f460d6e2d7b4c30203b98f50/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-07-12 13:16:28,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:16:28,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for b4c48074f460d6e2d7b4c30203b98f50: 2023-07-12 13:16:28,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1689167659304.b4c48074f460d6e2d7b4c30203b98f50. 2023-07-12 13:16:28,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing d2165571560ffa24987feffa1865ee2c, disabling compactions & flushes 2023-07-12 13:16:28,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:28,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:28,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. after waiting 0 ms 2023-07-12 13:16:28,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:28,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/default/testMajorCompactionFromAdmin/d2165571560ffa24987feffa1865ee2c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-12 13:16:28,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:28,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for d2165571560ffa24987feffa1865ee2c: 2023-07-12 13:16:28,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1689167768741.d2165571560ffa24987feffa1865ee2c. 2023-07-12 13:16:28,370 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 13:16:28,570 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 13:16:28,584 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/.tmp/info/904fec4f65494facb4f75f1237e776aa 2023-07-12 13:16:28,589 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 904fec4f65494facb4f75f1237e776aa 2023-07-12 13:16:28,770 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 13:16:28,783 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 13:16:28,783 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 13:16:28,971 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 13:16:28,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/.tmp/rep_barrier/39c301774ea54b1b9b3765089d039489 2023-07-12 13:16:28,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 39c301774ea54b1b9b3765089d039489 2023-07-12 13:16:29,171 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 13:16:29,171 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-12 13:16:29,171 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 13:16:29,371 DEBUG [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 13:16:29,404 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/.tmp/table/4d3333be135e4b18a6e24b0047827192 2023-07-12 13:16:29,408 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d3333be135e4b18a6e24b0047827192 2023-07-12 13:16:29,408 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/.tmp/info/904fec4f65494facb4f75f1237e776aa as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/info/904fec4f65494facb4f75f1237e776aa 2023-07-12 13:16:29,411 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 904fec4f65494facb4f75f1237e776aa 2023-07-12 13:16:29,411 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/info/904fec4f65494facb4f75f1237e776aa, entries=226, sequenceid=130, filesize=37.9 K 2023-07-12 13:16:29,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/.tmp/rep_barrier/39c301774ea54b1b9b3765089d039489 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/rep_barrier/39c301774ea54b1b9b3765089d039489 2023-07-12 13:16:29,415 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 39c301774ea54b1b9b3765089d039489 2023-07-12 13:16:29,415 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/rep_barrier/39c301774ea54b1b9b3765089d039489, entries=1, sequenceid=130, filesize=5.0 K 2023-07-12 13:16:29,416 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/.tmp/table/4d3333be135e4b18a6e24b0047827192 as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/table/4d3333be135e4b18a6e24b0047827192 2023-07-12 13:16:29,419 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d3333be135e4b18a6e24b0047827192 2023-07-12 13:16:29,419 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/table/4d3333be135e4b18a6e24b0047827192, entries=27, sequenceid=130, filesize=6.6 K 2023-07-12 13:16:29,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1253ms, sequenceid=130, compaction requested=false 2023-07-12 13:16:29,437 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-07-12 13:16:29,438 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 13:16:29,438 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 13:16:29,438 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 13:16:29,438 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 13:16:29,571 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,41721,1689167613545; all regions closed. 2023-07-12 13:16:29,579 DEBUG [RS:0;jenkins-hbase17:41721] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/oldWALs 2023-07-12 13:16:29,579 INFO [RS:0;jenkins-hbase17:41721] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C41721%2C1689167613545.meta:.meta(num 1689167615130) 2023-07-12 13:16:29,583 DEBUG [RS:0;jenkins-hbase17:41721] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/oldWALs 2023-07-12 13:16:29,583 INFO [RS:0;jenkins-hbase17:41721] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C41721%2C1689167613545:(num 1689167614930) 2023-07-12 13:16:29,583 DEBUG [RS:0;jenkins-hbase17:41721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:16:29,583 INFO [RS:0;jenkins-hbase17:41721] regionserver.LeaseManager(133): Closed leases 2023-07-12 13:16:29,583 INFO [RS:0;jenkins-hbase17:41721] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 13:16:29,583 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 13:16:29,584 INFO [RS:0;jenkins-hbase17:41721] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:41721 2023-07-12 13:16:29,591 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 13:16:29,591 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,41721,1689167613545 2023-07-12 13:16:29,591 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 13:16:29,592 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,41721,1689167613545] 2023-07-12 13:16:29,592 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,41721,1689167613545; numProcessing=1 2023-07-12 13:16:29,593 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,41721,1689167613545 already deleted, retry=false 2023-07-12 13:16:29,593 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,41721,1689167613545 expired; onlineServers=0 2023-07-12 13:16:29,593 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,41307,1689167612472' ***** 2023-07-12 13:16:29,593 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 13:16:29,594 DEBUG [M:0;jenkins-hbase17:41307] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6983e2e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-12 13:16:29,594 INFO [M:0;jenkins-hbase17:41307] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,41307,1689167612472 2023-07-12 13:16:29,594 INFO [M:0;jenkins-hbase17:41307] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,41307,1689167612472; all regions closed. 2023-07-12 13:16:29,594 DEBUG [M:0;jenkins-hbase17:41307] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:16:29,594 DEBUG [M:0;jenkins-hbase17:41307] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 13:16:29,594 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 13:16:29,594 DEBUG [M:0;jenkins-hbase17:41307] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 13:16:29,594 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689167614629] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689167614629,5,FailOnTimeoutGroup] 2023-07-12 13:16:29,594 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 13:16:29,594 INFO [M:0;jenkins-hbase17:41307] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 13:16:29,594 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689167614630] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689167614630,5,FailOnTimeoutGroup] 2023-07-12 13:16:29,594 INFO [M:0;jenkins-hbase17:41307] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 13:16:29,594 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:16:29,595 INFO [M:0;jenkins-hbase17:41307] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-07-12 13:16:29,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 13:16:29,595 DEBUG [M:0;jenkins-hbase17:41307] master.HMaster(1512): Stopping service threads 2023-07-12 13:16:29,595 INFO [M:0;jenkins-hbase17:41307] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 13:16:29,595 ERROR [M:0;jenkins-hbase17:41307] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-07-12 13:16:29,596 INFO [M:0;jenkins-hbase17:41307] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 13:16:29,596 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 13:16:29,597 DEBUG [M:0;jenkins-hbase17:41307] zookeeper.ZKUtil(398): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 13:16:29,597 WARN [M:0;jenkins-hbase17:41307] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 13:16:29,597 INFO [M:0;jenkins-hbase17:41307] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 13:16:29,597 INFO [M:0;jenkins-hbase17:41307] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 13:16:29,597 DEBUG [M:0;jenkins-hbase17:41307] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 13:16:29,597 INFO [M:0;jenkins-hbase17:41307] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:16:29,597 DEBUG [M:0;jenkins-hbase17:41307] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:16:29,597 DEBUG [M:0;jenkins-hbase17:41307] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 13:16:29,597 DEBUG [M:0;jenkins-hbase17:41307] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:16:29,597 INFO [M:0;jenkins-hbase17:41307] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.34 KB heapSize=599.16 KB 2023-07-12 13:16:29,614 INFO [M:0;jenkins-hbase17:41307] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.34 KB at sequenceid=1005 (bloomFilter=true), to=hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1cc6d61d157842019ebd315989bf79fc 2023-07-12 13:16:29,617 INFO [M:0;jenkins-hbase17:41307] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1cc6d61d157842019ebd315989bf79fc 2023-07-12 13:16:29,618 DEBUG [M:0;jenkins-hbase17:41307] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1cc6d61d157842019ebd315989bf79fc as hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1cc6d61d157842019ebd315989bf79fc 2023-07-12 13:16:29,621 INFO [M:0;jenkins-hbase17:41307] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1cc6d61d157842019ebd315989bf79fc 2023-07-12 13:16:29,622 INFO [M:0;jenkins-hbase17:41307] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35961/user/jenkins/test-data/20876372-96f3-0c7b-7194-c68449813161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1cc6d61d157842019ebd315989bf79fc, entries=123, sequenceid=1005, filesize=33.3 K 2023-07-12 13:16:29,622 INFO [M:0;jenkins-hbase17:41307] regionserver.HRegion(2948): Finished flush of dataSize ~513.34 KB/525658, heapSize ~599.15 KB/613528, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=1005, compaction requested=false 2023-07-12 13:16:29,623 INFO [M:0;jenkins-hbase17:41307] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:16:29,623 DEBUG [M:0;jenkins-hbase17:41307] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 13:16:29,626 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 13:16:29,626 INFO [M:0;jenkins-hbase17:41307] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 13:16:29,626 INFO [M:0;jenkins-hbase17:41307] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:41307 2023-07-12 13:16:29,628 DEBUG [M:0;jenkins-hbase17:41307] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,41307,1689167612472 already deleted, retry=false 2023-07-12 13:16:29,693 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 13:16:29,693 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x10159a9c1fc0001, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 13:16:29,693 INFO [RS:0;jenkins-hbase17:41721] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,41721,1689167613545; zookeeper connection closed. 2023-07-12 13:16:29,693 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6594419b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6594419b 2023-07-12 13:16:29,693 INFO [Listener at localhost.localdomain/44505] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-12 13:16:29,793 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 13:16:29,793 INFO [M:0;jenkins-hbase17:41307] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,41307,1689167612472; zookeeper connection closed. 2023-07-12 13:16:29,793 DEBUG [Listener at localhost.localdomain/44505-EventThread] zookeeper.ZKWatcher(600): master:41307-0x10159a9c1fc0000, quorum=127.0.0.1:51470, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 13:16:29,795 WARN [Listener at localhost.localdomain/44505] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 13:16:29,798 INFO [Listener at localhost.localdomain/44505] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 13:16:29,904 WARN [BP-1369082429-136.243.18.41-1689167609307 heartbeating to localhost.localdomain/127.0.0.1:35961] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 13:16:29,904 WARN [BP-1369082429-136.243.18.41-1689167609307 heartbeating to localhost.localdomain/127.0.0.1:35961] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1369082429-136.243.18.41-1689167609307 (Datanode Uuid ce58e839-c48d-499d-8202-1d751ffd3861) service to localhost.localdomain/127.0.0.1:35961 2023-07-12 13:16:29,906 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/cluster_2e6eebf2-882c-9df6-f703-f5434d9a427a/dfs/data/data1/current/BP-1369082429-136.243.18.41-1689167609307] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 13:16:29,907 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/473a0d57-31d7-0ce3-fad3-f90caac07580/cluster_2e6eebf2-882c-9df6-f703-f5434d9a427a/dfs/data/data2/current/BP-1369082429-136.243.18.41-1689167609307] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 13:16:29,935 INFO [Listener at localhost.localdomain/44505] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-12 13:16:30,079 INFO [Listener at localhost.localdomain/44505] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 13:16:30,222 INFO [Listener at localhost.localdomain/44505] hbase.HBaseTestingUtility(1293): Minicluster is down